-- Logs begin at Wed 2021-05-26 14:05:20 UTC, end at Wed 2021-05-26 15:20:23 UTC. -- May 26 14:49:26.710243 dv-cinder-784140-4-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 26 14:49:26.719463 dv-cinder-784140-4-iscsi devstack@n-api.service[103287]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 26 14:49:26.721442 dv-cinder-784140-4-iscsi devstack@n-api.service[103287]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed May 26 14:49:26 2021] *** May 26 14:49:26.721442 dv-cinder-784140-4-iscsi devstack@n-api.service[103287]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 26 14:49:26.721442 dv-cinder-784140-4-iscsi devstack@n-api.service[103287]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 26 14:49:26.721442 dv-cinder-784140-4-iscsi devstack@n-api.service[103287]: nodename: dv-cinder-784140-4-iscsi May 26 14:49:26.721442 dv-cinder-784140-4-iscsi devstack@n-api.service[103287]: machine: x86_64 May 26 14:49:26.721442 dv-cinder-784140-4-iscsi devstack@n-api.service[103287]: clock source: unix May 26 14:49:26.721442 dv-cinder-784140-4-iscsi devstack@n-api.service[103287]: pcre jit disabled May 26 14:49:26.721442 dv-cinder-784140-4-iscsi devstack@n-api.service[103287]: detected number of CPU cores: 4 May 26 14:49:26.721442 dv-cinder-784140-4-iscsi devstack@n-api.service[103287]: current working directory: / May 26 14:49:26.721442 dv-cinder-784140-4-iscsi devstack@n-api.service[103287]: detected binary path: /usr/bin/uwsgi-core May 26 14:49:26.722083 dv-cinder-784140-4-iscsi devstack@n-api.service[103287]: your processes number limit is 47680 May 26 14:49:26.722083 dv-cinder-784140-4-iscsi devstack@n-api.service[103287]: your memory page size is 4096 bytes May 26 14:49:26.722083 dv-cinder-784140-4-iscsi devstack@n-api.service[103287]: detected max file descriptor number: 2048 May 26 14:49:26.722083 dv-cinder-784140-4-iscsi devstack@n-api.service[103287]: lock engine: pthread robust mutexes May 26 14:49:26.722083 dv-cinder-784140-4-iscsi devstack@n-api.service[103287]: thunder lock: enabled May 26 14:49:26.722083 dv-cinder-784140-4-iscsi devstack@n-api.service[103287]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 26 14:49:26.722083 dv-cinder-784140-4-iscsi devstack@n-api.service[103287]: Python version: 3.8.5 (default, Jan 27 2021, 15:41:15) [GCC 9.3.0] May 26 14:49:26.761193 dv-cinder-784140-4-iscsi devstack@n-api.service[103287]: Python main interpreter initialized at 0x555a188469c0 May 26 14:49:26.761193 dv-cinder-784140-4-iscsi devstack@n-api.service[103287]: python threads support enabled May 26 14:49:26.761193 dv-cinder-784140-4-iscsi devstack@n-api.service[103287]: your server socket listen backlog is limited to 100 connections May 26 14:49:26.761193 dv-cinder-784140-4-iscsi devstack@n-api.service[103287]: your mercy for graceful operations on workers is 90 seconds May 26 14:49:26.761523 dv-cinder-784140-4-iscsi devstack@n-api.service[103287]: mapped 403077 bytes (393 KB) for 2 cores May 26 14:49:26.761624 dv-cinder-784140-4-iscsi devstack@n-api.service[103287]: *** Operational MODE: preforking *** May 26 14:49:26.761874 dv-cinder-784140-4-iscsi devstack@n-api.service[103287]: *** uWSGI is running in multiple interpreter mode *** May 26 14:49:26.761874 dv-cinder-784140-4-iscsi devstack@n-api.service[103287]: spawned uWSGI master process (pid: 103287) May 26 14:49:26.762051 dv-cinder-784140-4-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 26 14:49:26.762578 dv-cinder-784140-4-iscsi devstack@n-api.service[103287]: spawned uWSGI worker 1 (pid: 103288, cores: 1) May 26 14:49:26.762908 dv-cinder-784140-4-iscsi devstack@n-api.service[103287]: spawned uWSGI worker 2 (pid: 103289, cores: 1) May 26 14:49:26.763090 dv-cinder-784140-4-iscsi devstack@n-api.service[103287]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 26 14:49:28.376084 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 14:49:28.376084 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: from cryptography.utils import int_from_bytes May 26 14:49:28.376761 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 14:49:28.376761 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: from cryptography.utils import int_from_bytes May 26 14:49:28.376900 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 14:49:28.376900 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: from cryptography.utils import int_from_bytes May 26 14:49:28.377383 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 14:49:28.377383 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: from cryptography.utils import int_from_bytes May 26 14:49:30.969188 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 26 14:49:30.969773 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 26 14:49:30.969939 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 26 14:49:30.970312 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 26 14:49:30.970571 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 26 14:49:30.970963 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:30.971062 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 26 14:49:30.971416 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 26 14:49:30.971508 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:30.971600 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:30.971743 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 26 14:49:30.971913 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:30.972115 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 26 14:49:30.972248 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:30.972379 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 26 14:49:30.972564 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:30.972773 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:30.972889 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:30.973107 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:30.973200 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:30.973435 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:30.973526 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:30.973789 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:30.973884 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:30.974113 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:30.974206 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:30.974434 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:30.974518 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-784140-4-iscsi {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:30.974757 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:30.974852 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:30.975072 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:30.975159 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:30.975388 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:30.975478 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:30.975656 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:30.975746 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:30.975979 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:30.976071 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:30.976311 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-784140-4-iscsi {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:30.976396 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:30.976620 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:30.976710 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:30.976944 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:30.977123 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:30.977264 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:30.977603 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:30.977728 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:30.977921 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:30.978023 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:30.978777 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:30.978893 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:30.979125 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:30.979293 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:30.979517 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:30.979710 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:30.979923 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:30.980117 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:30.980309 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:30.980511 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:30.980663 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:30.980848 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:30.981075 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:30.981261 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:30.981454 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:30.981676 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:30.981866 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-784140-4-iscsi {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:30.982061 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:30.982249 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:30.982447 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:30.982636 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:30.982821 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:30.983006 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:30.983201 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:30.983396 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:30.983548 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:30.983726 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:30.983909 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-784140-4-iscsi {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:30.984072 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:30.984239 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:30.984390 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:30.984516 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:30.984653 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:30.984889 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:30.985027 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:30.985153 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:30.985278 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:30.985401 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:30.985592 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:30.985720 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:30.985861 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:30.985996 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:30.986127 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:30.986251 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:30.986387 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:30.986513 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:30.986636 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:30.986758 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:30.986909 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:30.987042 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:30.987167 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:30.987295 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:30.987420 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:30.987420 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:30.987663 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:30.987797 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:30.987927 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:30.988057 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:30.988187 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:30.988323 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:30.988458 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:30.988665 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:30.988793 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:30.988923 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:30.989051 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:30.989182 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:30.989319 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:30.989487 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:30.989654 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:30.989789 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:30.989916 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:30.990039 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:30.990171 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:30.990296 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:30.990426 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:30.990552 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:30.990674 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:30.990837 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:30.990977 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:30.991143 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:30.991271 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:30.991451 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:30.991585 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:30.991762 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:30.991890 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:30.992072 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:30.992206 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:30.992382 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:30.992509 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:30.992692 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:30.993113 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:30.993241 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:30.993377 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:30.993503 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:30.993663 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:30.993851 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:30.993982 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:30.994114 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:30.994239 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:30.994363 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:30.994602 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.81 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:30.994772 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:30.994920 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.81 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:30.995124 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:30.995244 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:30.995386 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:30.995522 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:30.995647 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:30.995805 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:30.995940 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:30.996123 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:30.996250 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.81 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:30.996453 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:30.996581 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.81 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:30.996781 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:30.996909 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:30.997094 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:30.997229 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:30.997405 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:30.997534 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:30.997743 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:30.997875 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:30.998068 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:30.998209 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:30.998393 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:30.998519 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:30.998698 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:30.998830 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:30.998956 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:30.999100 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:30.999226 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:30.999350 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:30.999537 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:30.999656 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:30.999861 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:31.000002 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:31.000170 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:31.000304 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:31.000469 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:31.000595 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:31.000776 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:31.000910 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:31.001080 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:31.001215 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:31.001388 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:31.001530 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:31.001726 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:31.001861 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:31.002034 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:31.002168 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:31.002343 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:31.002468 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:31.002648 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:31.002777 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:31.002954 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:31.003086 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:31.003262 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:31.003396 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:31.003567 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:31.003693 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:31.003874 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:31.004001 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:31.004186 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:31.004321 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:31.004497 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:31.004633 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:31.004805 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:31.004930 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:31.005115 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:31.005239 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:31.005421 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:31.005516 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:31.005756 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:31.005861 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:31.006082 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:31.006173 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:31.006396 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:31.006485 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:31.006706 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:31.006789 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:31.007018 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:31.007110 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:31.007327 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:31.007410 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:31.007636 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:31.007721 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:31.007949 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:31.008030 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:31.008257 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:31.008341 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:31.008568 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:31.008652 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:31.008879 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:31.008970 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:31.009182 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:31.009265 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:31.009521 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:31.009642 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:31.009861 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:31.009987 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:31.010169 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:31.010270 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:31.010478 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:31.010563 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:31.010785 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:31.010881 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:31.011095 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:31.011179 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:31.011402 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:31.011493 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:31.011711 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:31.011806 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:31.012019 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:31.012102 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:31.012326 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:31.012408 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:31.012628 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:31.012714 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:31.012934 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:31.013016 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:31.013246 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:31.013330 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:31.013582 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:31.013669 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:31.013899 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:31.013983 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:31.014210 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:31.014295 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:31.014533 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:31.014625 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:31.014861 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:31.014951 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.015177 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:31.015264 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.015493 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:31.015596 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.015803 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:31.015887 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.016129 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:49:31.016221 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.016471 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.016561 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.016795 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.016879 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.017113 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.017209 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.017434 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.017518 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.017806 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.017910 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.018125 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.018222 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.018442 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.018525 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.018758 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.018840 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.019079 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.019162 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.019403 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.019499 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.019721 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.019816 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.020043 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.020135 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.020359 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.020449 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.020683 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.020775 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.020997 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.021090 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.021320 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.021404 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.021668 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.021755 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.021998 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.022083 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.022313 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.022439 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.022629 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.022766 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.022955 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.023041 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.023293 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.023376 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.023619 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.023701 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.023935 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.024018 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.024261 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.024344 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.024580 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.024663 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.024896 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.025488 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.025766 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.025907 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.026091 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.026236 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.026410 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.026572 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.026727 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.026897 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.027077 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.027222 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.027404 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.027545 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.027727 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.027872 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.028038 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.028197 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.028350 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.028518 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.028662 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.028865 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.028980 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.029194 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.029278 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.029519 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.029657 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.029859 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.029963 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.030179 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.030265 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.030494 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.030577 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.030815 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.030910 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.031128 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.031218 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.031458 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.031542 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.031767 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.031857 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.032086 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.032170 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.032401 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.032485 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.032712 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.032839 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.033030 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.033113 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.033345 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.033427 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.033681 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.033780 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.034003 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.034086 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.034310 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.034393 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.034620 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.034705 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.035193 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.035279 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.035510 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.035594 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.035821 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.035913 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.036133 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.036222 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.036450 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.036532 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.036764 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.036849 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.037076 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.037158 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.037394 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.037485 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.037741 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.037827 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.038062 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.038155 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.038390 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.038480 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.038712 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.038796 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.039029 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.039112 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.039336 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.039493 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.039653 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.039737 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.039964 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.040047 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.040273 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.040376 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.040716 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.041302 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.041570 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.041792 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.041891 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.041978 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.042183 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.042273 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.042496 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.042579 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.042806 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.042934 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.043115 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.043198 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.043434 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.043516 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.043746 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.043835 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.044056 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.044139 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.044365 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.044453 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.044673 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.044756 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.044985 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.045068 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.045315 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.045406 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.045671 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.045756 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.045985 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.046080 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.046299 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.046396 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.046610 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.046700 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.046959 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.047043 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.047273 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.047365 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.047585 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.047681 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.047905 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.048007 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.048235 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.048328 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.048547 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.048631 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.048864 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.048949 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.049172 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.049263 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.049482 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.049588 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.049827 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.049912 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.050165 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.050292 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.050474 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.050557 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.050789 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.050872 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.051098 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.051188 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.051416 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.051501 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.051729 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.051811 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.052048 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.052132 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.052360 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.052451 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.052672 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.052763 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.052988 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.053071 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.053303 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.053392 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.053641 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.053743 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.053959 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.054049 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.054267 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.054349 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.054576 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.054667 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.054888 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.054970 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.055198 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.055281 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.055507 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.055599 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.055820 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.055939 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.056132 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.056279 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.056498 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.056598 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.056804 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.056896 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.057114 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.057205 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.057425 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.057510 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.057760 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.057844 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.058088 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.058172 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.058401 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.058485 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.058712 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.058802 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.059023 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.059107 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.059332 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.059417 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.059641 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.059723 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.059972 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.060067 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.060279 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.060408 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.060594 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.060684 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.060907 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.060999 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.061217 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.061306 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.061535 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.061640 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.061871 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.061968 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.062184 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.062267 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.062504 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.062586 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.062820 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.062909 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.063132 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.063216 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.063446 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.063536 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.063758 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.063843 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.064071 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.064162 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.064384 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.064467 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.064703 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.064787 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.065016 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.065099 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.065331 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.065412 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.065666 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.065753 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.065980 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.066066 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.066295 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.066385 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.066614 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.066699 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.066927 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.067202 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.067285 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.067543 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.067635 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.067850 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.067933 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.068166 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.068251 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.068489 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.068573 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.068813 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.069064 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.069148 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.069408 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.069626 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.069761 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.069846 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.070097 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.070224 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.070427 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.070521 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.070736 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.070826 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.071048 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.071133 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.071366 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.071457 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.071677 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.071761 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.072015 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.072105 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.072343 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.072463 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.072659 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.072787 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.072972 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.073102 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.073293 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.073415 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.073642 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.073752 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.073959 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.074066 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.074274 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.074388 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.074595 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.074683 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.074907 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.074999 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.075219 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.075309 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.075531 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.075614 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.075844 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.075935 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.076167 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.076259 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.076481 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.076566 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.076799 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.076892 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.077111 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.077195 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.077441 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.077524 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.077787 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.077887 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.078101 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.078185 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.078415 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.078506 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.078726 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.078811 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.079064 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.079146 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.079374 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.079455 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.079697 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.079787 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.080010 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.080099 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.080322 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.080413 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.080641 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.080731 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.080957 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.081041 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.081266 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.081349 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.081616 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.081703 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.081932 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.082017 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.082245 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.082336 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.082553 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.082649 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.082868 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.082951 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.083174 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.083256 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.083496 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.083580 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.083806 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.083891 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.084117 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.084210 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.084426 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.084544 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.084737 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.084827 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.085045 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.085129 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.085350 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.085440 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.085697 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.085782 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.086012 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.086095 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.086318 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.086413 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.086633 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.086722 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.086946 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.087028 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.087252 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.087342 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.088107 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.088218 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.088423 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.088551 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.088735 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.088877 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.089052 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.089189 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.089365 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.089508 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.089700 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.089845 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.090018 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.090158 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.090350 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.090483 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.090679 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.090764 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.090991 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.091079 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.091309 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.091392 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.091622 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.091707 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.091935 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.092018 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.092241 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.092330 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.092554 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.092636 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.092862 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.092946 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.093168 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.093259 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.093475 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.093607 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.093807 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.093891 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.094116 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.094277 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.094445 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.094529 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.094761 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.094844 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.095073 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.095211 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.095388 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.095480 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.095697 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.095781 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.096015 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.096105 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.096334 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.096419 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.096654 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.096737 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.096963 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.097048 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.097286 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.097369 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.097630 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.097718 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.097947 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.098032 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.098254 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.098336 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.098565 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.098660 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.098873 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.098962 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.099195 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.099278 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.099509 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.099660 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.099826 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.099910 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.100138 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.100229 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.100456 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.100581 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.100770 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.100854 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.101088 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.101172 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.101403 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.101493 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.101741 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.101825 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.102058 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.102142 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.102375 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.102471 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.102691 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.102777 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.103005 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.103171 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.103890 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.103984 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.104213 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.104319 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.104527 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.104619 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.104839 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.104936 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.105155 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.105240 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.105471 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.105590 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.105811 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.105898 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.106129 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.106218 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.106445 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.106528 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.106756 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.106841 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.107070 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.107154 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.107385 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.107471 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.107694 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.107778 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.108006 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.108088 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.108330 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.108446 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.108643 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.108768 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.108960 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.109086 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.109274 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.109397 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.109616 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.109742 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.109934 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.110064 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.110380 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.110477 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.110699 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.110782 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.111011 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.111101 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.111322 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.111438 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.111641 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.111757 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.111981 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.112064 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.112285 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.112376 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.112608 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.112693 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.112922 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.113014 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.113274 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.113358 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.113630 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.113727 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.113944 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.114028 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.114255 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.114341 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.114567 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.114650 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.114892 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.114981 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.115203 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.115293 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.115531 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.115655 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.115845 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.115954 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.116157 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.116269 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.116471 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.116588 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.116803 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.116973 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.117116 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.117297 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.117447 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.117677 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.117907 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.118031 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.118228 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.118345 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.118545 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.118661 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.118994 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.119122 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.119311 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.119421 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.119630 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.119803 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.119963 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.120129 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.120299 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.120458 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.120633 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.120807 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.120932 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.121103 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.121257 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.121415 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.121600 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.121776 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.121937 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.122106 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.122270 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.122429 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.122591 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.122759 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.122916 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.123184 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.123275 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.123515 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.123600 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.123832 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.123917 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.124160 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.124244 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.124490 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.124573 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.124801 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.124915 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.125113 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.125247 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.125432 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.125601 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.125771 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.125916 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.126085 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.126251 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.126417 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.126566 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.126729 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.126877 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.127046 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.127197 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.127369 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.127510 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.127686 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.127825 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.127996 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.128156 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.128306 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.128469 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.128632 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.128789 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.128940 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.129108 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.129269 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.129425 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.129612 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.129765 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.129947 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.130079 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.130276 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.130416 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.130591 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.130729 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.130919 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.131063 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.131285 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.131395 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.131544 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.131705 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.131857 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.132037 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.132165 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.132353 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.132514 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.132683 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.132824 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.133003 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.133151 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.133316 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.133488 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.133654 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.133853 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.133968 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.134171 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.134826 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.135028 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.135147 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.135400 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.135507 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.135687 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.135804 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.136011 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.136144 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.136342 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.136482 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.136654 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.136812 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.136966 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.137094 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.137284 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.137422 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.137618 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.137774 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.137935 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.138109 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.138244 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.138422 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.138559 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.138733 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.138867 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.139052 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.139176 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.139366 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.139483 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.139680 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.139813 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.139991 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.140122 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.140308 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.140451 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.140618 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.140768 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.140930 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.141077 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.141241 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.141386 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.141593 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.141717 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.141908 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.142068 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.142238 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.142380 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.142558 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.142721 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.142869 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.143046 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.143183 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.143376 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.143493 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.143710 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.143845 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.144027 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.144159 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.144358 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.144501 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.144682 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.144828 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.145003 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.145159 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.145325 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.145498 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.145671 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.145844 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.145994 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.146177 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.146316 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.146504 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.146638 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.146830 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.146955 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.147156 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.147275 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.147480 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.147598 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.147805 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.147924 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.148131 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.148455 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.148545 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.148773 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.148893 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.149096 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.149184 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.149415 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.149497 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.149766 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.149849 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.150686 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.150914 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.151007 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.151301 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.151384 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.151625 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.151762 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.151946 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.152049 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.152266 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.152366 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.152601 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.152708 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.152934 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.153055 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.153261 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.153359 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.153610 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.153710 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.153939 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.154038 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.154262 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.154370 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.154588 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.154687 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.154919 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.155018 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.155260 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.155367 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.155600 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.155696 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.155916 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.156020 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.156242 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.156349 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.156570 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.156669 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.156896 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.156987 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.157221 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.157333 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.157557 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.157656 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.157906 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.157998 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.158235 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.158321 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.158559 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.158643 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.158877 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.158964 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.159201 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.159285 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.159521 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.159607 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.160103 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.160200 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.160436 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.160520 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.160764 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.160848 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.161081 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.161172 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.161403 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.161486 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.161753 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.161887 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.162091 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.162279 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.162444 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.162602 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.162776 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.162942 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.163100 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.163270 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.163424 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.163601 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.163749 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.163924 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.164247 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.164333 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.164580 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.164665 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.164894 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.164978 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.165208 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.165294 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.165526 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.165701 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.165989 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.166107 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.166305 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.166505 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.166638 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.166848 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.166957 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.167168 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.167255 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.167484 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.167589 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.167808 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.167893 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.168129 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.168434 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.168518 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.168762 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.168846 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.169084 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.169176 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.169398 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.169482 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.169756 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.169843 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.170075 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.170214 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.170393 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.170622 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.170714 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.170984 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.171081 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.171315 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.171398 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.171635 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.171718 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.171953 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.172051 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.172266 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.172351 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.172578 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.172674 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.172897 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.172994 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.173209 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.173291 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.173516 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.173633 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.173863 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.173947 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.174181 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.174264 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.174495 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.174585 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.174809 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.174895 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.175128 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.175213 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.175435 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.175517 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.175743 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.175827 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.176053 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.176136 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.176360 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.176443 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.176670 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.176753 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.176980 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.177064 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.177293 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.177379 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.177627 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.177715 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.177946 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.178029 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.178257 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.178357 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.178571 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.178655 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.178879 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.178961 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.179187 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.179278 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.179498 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.179583 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.179807 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.180019 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.180109 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.180337 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.180422 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.180652 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.180735 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.180976 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.181059 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.181373 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.181464 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.181764 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.181850 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.182091 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.182413 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.182770 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.183001 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.183093 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.183342 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.183624 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.183718 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.183966 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.184051 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.184297 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.184380 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.184644 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.184740 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.184977 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.185062 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.185289 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.185380 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.185627 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.185727 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.185943 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.186028 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.186272 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.186528 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.186622 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.186877 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.187007 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.187193 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.187277 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.187515 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.187610 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.187830 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.187915 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.188146 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.188230 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.188461 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.188553 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.188776 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.188861 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.189089 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.189172 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.189403 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.189489 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.189763 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.189848 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.190084 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.190171 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.190405 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.190489 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.190720 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.190803 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.191039 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.191122 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.191355 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.191439 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.191671 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.191760 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.191988 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.192079 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.192304 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.192388 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.192623 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.192706 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.192963 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.193065 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.193285 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.193379 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.193622 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.193711 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.193958 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.194053 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.194281 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.194367 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.194604 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.194695 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.194925 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.195019 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.195246 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.195337 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.195572 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.195657 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.195913 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.195999 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.196240 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.196325 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.196557 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.196641 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.197470 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.197580 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.197871 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.197955 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.198252 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.198344 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.198573 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.198661 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.198918 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.199007 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.199261 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.199353 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.199588 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.199671 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.199919 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.200012 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.200256 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.200348 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.200571 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.200653 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.200885 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.200967 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.201198 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.201289 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.201513 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.201624 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.201854 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.201937 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.202181 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.202317 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.202498 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.202584 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.202820 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.202911 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.203136 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.203221 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.203467 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.203551 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.203785 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.203871 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.204107 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.204191 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.204415 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.204498 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.204735 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.204823 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.205047 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.205130 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.205368 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.205460 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.205722 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.205808 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.206042 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.206128 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.206371 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.206462 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.206687 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.206772 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.207015 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.207098 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.207325 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.207408 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.207650 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.207741 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.207972 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.208062 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.208291 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.208382 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.208607 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.208705 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.208940 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.209023 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.209251 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.209341 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.209582 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.209683 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.209904 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.209989 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.210221 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.210306 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.210537 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.210668 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.210853 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.210938 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.211184 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.211266 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.211508 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.211601 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.211817 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.211902 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.212150 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.212240 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.212519 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.213110 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.213331 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.213415 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.213680 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.213766 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.214003 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.214097 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.214322 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.214407 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.214660 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.214753 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.214996 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.215081 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.215310 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.215393 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.215628 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.215725 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.215952 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.216036 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.216270 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.216353 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.216594 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.216689 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.216915 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.217001 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.217243 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.217325 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.217594 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.217693 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.217904 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.217988 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.218223 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.218307 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.218543 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.218628 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.218868 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.218953 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.219128 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 26 14:49:31.219255 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.219514 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.219846 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.220180 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.220512 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.220865 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.221185 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.221555 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.221899 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:49:31.222150 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 26 14:49:31.252642 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG oslo_db.sqlalchemy.engines [None req-ef51eb58-a1d1-4875-a573-bbf2ffe7661d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103288) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 14:49:31.253468 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG oslo_db.sqlalchemy.engines [None req-cabad187-55c7-4eb0-885f-effc0bc5a14e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103289) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 14:49:31.495294 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.context [None req-ef51eb58-a1d1-4875-a573-bbf2ffe7661d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1138cb42-e84c-4925-8485-16faa4f9e877(cell1) {{(pid=103288) load_cells /opt/stack/nova/nova/context.py:464}} May 26 14:49:31.498470 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.context [None req-cabad187-55c7-4eb0-885f-effc0bc5a14e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1138cb42-e84c-4925-8485-16faa4f9e877(cell1) {{(pid=103289) load_cells /opt/stack/nova/nova/context.py:464}} May 26 14:49:31.499537 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG oslo_concurrency.lockutils [None req-ef51eb58-a1d1-4875-a573-bbf2ffe7661d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:49:31.501170 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG oslo_concurrency.lockutils [None req-ef51eb58-a1d1-4875-a573-bbf2ffe7661d None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:49:31.502005 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG oslo_concurrency.lockutils [None req-ef51eb58-a1d1-4875-a573-bbf2ffe7661d None None] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:49:31.502761 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG oslo_concurrency.lockutils [None req-cabad187-55c7-4eb0-885f-effc0bc5a14e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:49:31.503988 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG oslo_concurrency.lockutils [None req-ef51eb58-a1d1-4875-a573-bbf2ffe7661d None None] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:49:31.504411 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG oslo_concurrency.lockutils [None req-cabad187-55c7-4eb0-885f-effc0bc5a14e None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:49:31.505236 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG oslo_concurrency.lockutils [None req-cabad187-55c7-4eb0-885f-effc0bc5a14e None None] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:49:31.507302 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG oslo_concurrency.lockutils [None req-cabad187-55c7-4eb0-885f-effc0bc5a14e None None] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:49:31.528339 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG oslo_db.sqlalchemy.engines [None req-ef51eb58-a1d1-4875-a573-bbf2ffe7661d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103288) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 14:49:31.536819 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG oslo_db.sqlalchemy.engines [None req-ef51eb58-a1d1-4875-a573-bbf2ffe7661d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103288) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 14:49:31.539047 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG oslo_db.sqlalchemy.engines [None req-cabad187-55c7-4eb0-885f-effc0bc5a14e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103289) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 14:49:31.540279 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG oslo_db.sqlalchemy.engines [None req-cabad187-55c7-4eb0-885f-effc0bc5a14e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103289) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 14:49:31.564304 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG oslo_db.sqlalchemy.engines [None req-ef51eb58-a1d1-4875-a573-bbf2ffe7661d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103288) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 14:49:31.573460 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG oslo_db.sqlalchemy.engines [None req-cabad187-55c7-4eb0-885f-effc0bc5a14e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103289) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 14:49:32.086026 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: WARNING keystonemiddleware.auth_token [None req-cabad187-55c7-4eb0-885f-effc0bc5a14e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 26 14:49:32.092783 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: WARNING keystonemiddleware.auth_token [None req-cabad187-55c7-4eb0-885f-effc0bc5a14e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 26 14:49:32.115104 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: WARNING keystonemiddleware.auth_token [None req-ef51eb58-a1d1-4875-a573-bbf2ffe7661d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 26 14:49:32.122198 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: WARNING keystonemiddleware.auth_token [None req-ef51eb58-a1d1-4875-a573-bbf2ffe7661d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 26 14:49:32.325326 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: WARNING keystonemiddleware.auth_token [None req-cabad187-55c7-4eb0-885f-effc0bc5a14e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 26 14:49:32.330526 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: WARNING keystonemiddleware.auth_token [None req-cabad187-55c7-4eb0-885f-effc0bc5a14e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 26 14:49:32.335840 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x555a188469c0 pid: 103289 (default app) May 26 14:49:32.338599 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi [None req-cabad187-55c7-4eb0-885f-effc0bc5a14e None None] Calling method '>' {{(pid=103289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:49:32.339682 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: INFO nova.api.openstack.requestlog [None req-cabad187-55c7-4eb0-885f-effc0bc5a14e None None] 10.222.0.81 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.002305 May 26 14:49:32.340085 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: [pid: 103289|app: 0|req: 1/1] 10.222.0.81 () {50 vars in 789 bytes} [Wed May 26 14:49:32 2021] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:49:32.348431 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: WARNING keystonemiddleware.auth_token [None req-ef51eb58-a1d1-4875-a573-bbf2ffe7661d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 26 14:49:32.354234 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: WARNING keystonemiddleware.auth_token [None req-ef51eb58-a1d1-4875-a573-bbf2ffe7661d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 26 14:49:32.359503 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x555a188469c0 pid: 103288 (default app) May 26 14:50:55.556951 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi [None req-cabad187-55c7-4eb0-885f-effc0bc5a14e None None] Calling method '>' {{(pid=103289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:50:55.558087 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: INFO nova.api.openstack.requestlog [None req-cabad187-55c7-4eb0-885f-effc0bc5a14e None None] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001540 May 26 14:50:55.558504 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: [pid: 103289|app: 0|req: 2/2] 10.222.0.81 () {54 vars in 930 bytes} [Wed May 26 14:50:55 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:50:56.149413 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi [None req-04f96f18-9934-4df2-8d49-ca2a912b197a admin admin] Calling method '>' {{(pid=103288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:50:56.176073 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: INFO nova.api.openstack.requestlog [None req-04f96f18-9934-4df2-8d49-ca2a912b197a admin admin] 10.222.0.81 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.610191 May 26 14:50:56.176947 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: [pid: 103288|app: 0|req: 1/3] 10.222.0.81 () {60 vars in 1291 bytes} [Wed May 26 14:50:55 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:50:58.338873 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi [None req-cabad187-55c7-4eb0-885f-effc0bc5a14e None None] Calling method '>' {{(pid=103289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:50:58.340677 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: INFO nova.api.openstack.requestlog [None req-cabad187-55c7-4eb0-885f-effc0bc5a14e None None] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002187 May 26 14:50:58.341123 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: [pid: 103289|app: 0|req: 3/4] 10.222.0.81 () {54 vars in 930 bytes} [Wed May 26 14:50:58 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:50:58.406824 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi [None req-bf6a855c-33c1-4ccf-9894-9789446b5253 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "swap": 0, "name": "cirros256", "os-flavor-access:is_public": true, "id": "c1", "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "ram": 256}} {{(pid=103288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:50:58.426302 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 14:50:58.426302 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: warnings.warn(msg) May 26 14:50:58.503108 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: INFO nova.api.openstack.requestlog [None req-bf6a855c-33c1-4ccf-9894-9789446b5253 admin admin] 10.222.0.81 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.154879 May 26 14:50:58.504097 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: [pid: 103288|app: 0|req: 2/5] 10.222.0.81 () {64 vars in 1282 bytes} [Wed May 26 14:50:58 2021] POST /compute/v2.1/flavors => generated 407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 26 14:50:58.846894 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi [None req-7f0fb247-24c9-490b-960a-fbac902c9c04 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:50:58.849197 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 14:50:58.849197 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: warnings.warn(msg) May 26 14:50:58.969852 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: INFO nova.api.openstack.requestlog [None req-7f0fb247-24c9-490b-960a-fbac902c9c04 admin admin] 10.222.0.81 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.457992 May 26 14:50:58.974541 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: [pid: 103289|app: 0|req: 4/6] 10.222.0.81 () {64 vars in 1335 bytes} [Wed May 26 14:50:58 2021] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:51:01.150296 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi [None req-bf6a855c-33c1-4ccf-9894-9789446b5253 admin admin] Calling method '>' {{(pid=103288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:51:01.151327 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: INFO nova.api.openstack.requestlog [None req-bf6a855c-33c1-4ccf-9894-9789446b5253 admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001509 May 26 14:51:01.152116 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: [pid: 103288|app: 0|req: 3/7] 10.222.0.81 () {54 vars in 930 bytes} [Wed May 26 14:51:01 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:51:01.267253 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi [None req-c6991baa-5ecb-45b4-b556-9ef7a6403bce admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 5, "rxtx_factor": 1.0, "vcpus": 1, "ram": 512, "os-flavor-access:is_public": true, "name": "ds512M", "swap": 0, "id": "d1", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:51:01.286146 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 14:51:01.286146 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: warnings.warn(msg) May 26 14:51:01.375135 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: INFO nova.api.openstack.requestlog [None req-c6991baa-5ecb-45b4-b556-9ef7a6403bce admin admin] 10.222.0.81 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.216810 May 26 14:51:01.375610 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: [pid: 103289|app: 0|req: 5/8] 10.222.0.81 () {64 vars in 1282 bytes} [Wed May 26 14:51:01 2021] POST /compute/v2.1/flavors => generated 404 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 26 14:51:01.387652 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi [None req-34a6b0f6-2fc3-410c-afdc-7d959a0ace96 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:51:01.389214 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 14:51:01.389214 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: warnings.warn(msg) May 26 14:51:01.497254 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: INFO nova.api.openstack.requestlog [None req-34a6b0f6-2fc3-410c-afdc-7d959a0ace96 admin admin] 10.222.0.81 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.113204 May 26 14:51:01.497804 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: [pid: 103288|app: 0|req: 4/9] 10.222.0.81 () {64 vars in 1335 bytes} [Wed May 26 14:51:01 2021] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:51:03.632958 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi [None req-c6991baa-5ecb-45b4-b556-9ef7a6403bce admin admin] Calling method '>' {{(pid=103289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:51:03.634145 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: INFO nova.api.openstack.requestlog [None req-c6991baa-5ecb-45b4-b556-9ef7a6403bce admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001736 May 26 14:51:03.634562 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: [pid: 103289|app: 0|req: 6/10] 10.222.0.81 () {54 vars in 930 bytes} [Wed May 26 14:51:03 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:51:03.692791 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi [None req-9e9bfbd5-aaee-4ff2-9196-4f031b27a74d admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "d2", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 1024, "disk": 10, "swap": 0, "vcpus": 1, "name": "ds1G"}} {{(pid=103288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:51:03.782076 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: INFO nova.api.openstack.requestlog [None req-9e9bfbd5-aaee-4ff2-9196-4f031b27a74d admin admin] 10.222.0.81 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.141343 May 26 14:51:03.790624 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: [pid: 103288|app: 0|req: 5/11] 10.222.0.81 () {64 vars in 1282 bytes} [Wed May 26 14:51:03 2021] POST /compute/v2.1/flavors => generated 404 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 26 14:51:03.795871 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi [None req-27fa56de-8526-4b32-af2a-4effa78a2dbb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:51:03.893980 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: INFO nova.api.openstack.requestlog [None req-27fa56de-8526-4b32-af2a-4effa78a2dbb admin admin] 10.222.0.81 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.101924 May 26 14:51:03.904352 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: [pid: 103289|app: 0|req: 7/12] 10.222.0.81 () {64 vars in 1335 bytes} [Wed May 26 14:51:03 2021] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:51:06.073457 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi [None req-9e9bfbd5-aaee-4ff2-9196-4f031b27a74d admin admin] Calling method '>' {{(pid=103288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:51:06.074533 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: INFO nova.api.openstack.requestlog [None req-9e9bfbd5-aaee-4ff2-9196-4f031b27a74d admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001520 May 26 14:51:06.074948 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: [pid: 103288|app: 0|req: 6/13] 10.222.0.81 () {54 vars in 930 bytes} [Wed May 26 14:51:06 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:51:06.133110 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi [None req-d1c21078-8315-45d8-a40b-489754ff743b admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "os-flavor-access:is_public": true, "id": "d3", "swap": 0, "name": "ds2G", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "rxtx_factor": 1.0, "vcpus": 2}} {{(pid=103289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:51:06.220628 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: INFO nova.api.openstack.requestlog [None req-d1c21078-8315-45d8-a40b-489754ff743b admin admin] 10.222.0.81 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.139426 May 26 14:51:06.221404 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: [pid: 103289|app: 0|req: 8/14] 10.222.0.81 () {64 vars in 1282 bytes} [Wed May 26 14:51:06 2021] POST /compute/v2.1/flavors => generated 404 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 14:51:06.233343 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi [None req-c8fb449d-0028-4aee-8dea-2dabac134a71 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:51:06.332141 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: INFO nova.api.openstack.requestlog [None req-c8fb449d-0028-4aee-8dea-2dabac134a71 admin admin] 10.222.0.81 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.102354 May 26 14:51:06.332884 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: [pid: 103288|app: 0|req: 7/15] 10.222.0.81 () {64 vars in 1335 bytes} [Wed May 26 14:51:06 2021] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:51:08.497306 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi [None req-d1c21078-8315-45d8-a40b-489754ff743b admin admin] Calling method '>' {{(pid=103289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:51:08.498434 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: INFO nova.api.openstack.requestlog [None req-d1c21078-8315-45d8-a40b-489754ff743b admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001560 May 26 14:51:08.499046 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: [pid: 103289|app: 0|req: 9/16] 10.222.0.81 () {54 vars in 930 bytes} [Wed May 26 14:51:08 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:51:08.567102 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi [None req-a967ef2f-63f2-4cb3-a346-1232c40ad825 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds4G", "vcpus": 4, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "d4", "swap": 0, "disk": 20, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:51:08.682920 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: INFO nova.api.openstack.requestlog [None req-a967ef2f-63f2-4cb3-a346-1232c40ad825 admin admin] 10.222.0.81 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.177627 May 26 14:51:08.690053 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: [pid: 103288|app: 0|req: 8/17] 10.222.0.81 () {64 vars in 1282 bytes} [Wed May 26 14:51:08 2021] POST /compute/v2.1/flavors => generated 404 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 26 14:51:08.695939 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi [None req-63dadaa6-f8da-437a-9576-47571c400ae5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:51:08.788909 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: INFO nova.api.openstack.requestlog [None req-63dadaa6-f8da-437a-9576-47571c400ae5 admin admin] 10.222.0.81 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.097481 May 26 14:51:08.801788 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: [pid: 103289|app: 0|req: 10/18] 10.222.0.81 () {64 vars in 1335 bytes} [Wed May 26 14:51:08 2021] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:51:10.963595 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi [None req-a967ef2f-63f2-4cb3-a346-1232c40ad825 admin admin] Calling method '>' {{(pid=103288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:51:10.965160 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: INFO nova.api.openstack.requestlog [None req-a967ef2f-63f2-4cb3-a346-1232c40ad825 admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003697 May 26 14:51:10.965898 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: [pid: 103288|app: 0|req: 9/19] 10.222.0.81 () {54 vars in 930 bytes} [Wed May 26 14:51:10 2021] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:51:11.038845 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi [None req-da677d75-909b-4213-bb81-4156b932f55c admin admin] Calling method '>' {{(pid=103289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:51:11.060547 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: INFO nova.api.openstack.requestlog [None req-da677d75-909b-4213-bb81-4156b932f55c admin admin] 10.222.0.81 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.088084 May 26 14:51:11.061016 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: [pid: 103289|app: 0|req: 11/20] 10.222.0.81 () {60 vars in 1291 bytes} [Wed May 26 14:51:10 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:51:13.195797 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi [None req-a967ef2f-63f2-4cb3-a346-1232c40ad825 admin admin] Calling method '>' {{(pid=103288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:51:13.196836 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: INFO nova.api.openstack.requestlog [None req-a967ef2f-63f2-4cb3-a346-1232c40ad825 admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001514 May 26 14:51:13.197249 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: [pid: 103288|app: 0|req: 10/21] 10.222.0.81 () {54 vars in 930 bytes} [Wed May 26 14:51:13 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 14:51:13.257925 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi [None req-09c4e467-88ae-4a2f-b074-d65227d67c99 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "id": "1", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 1, "swap": 0, "name": "m1.tiny", "ram": 512}} {{(pid=103289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:51:13.334268 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: INFO nova.api.openstack.requestlog [None req-09c4e467-88ae-4a2f-b074-d65227d67c99 admin admin] 10.222.0.81 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.129208 May 26 14:51:13.334692 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: [pid: 103289|app: 0|req: 12/22] 10.222.0.81 () {64 vars in 1282 bytes} [Wed May 26 14:51:13 2021] POST /compute/v2.1/flavors => generated 402 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 14:51:13.346058 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi [None req-2c601cd9-fb85-412b-af57-1beae1c4c295 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:51:13.456018 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: INFO nova.api.openstack.requestlog [None req-2c601cd9-fb85-412b-af57-1beae1c4c295 admin admin] 10.222.0.81 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.113369 May 26 14:51:13.456533 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: [pid: 103288|app: 0|req: 11/23] 10.222.0.81 () {64 vars in 1332 bytes} [Wed May 26 14:51:13 2021] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:51:15.733149 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi [None req-09c4e467-88ae-4a2f-b074-d65227d67c99 admin admin] Calling method '>' {{(pid=103289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:51:15.734681 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: INFO nova.api.openstack.requestlog [None req-09c4e467-88ae-4a2f-b074-d65227d67c99 admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002028 May 26 14:51:15.735174 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: [pid: 103289|app: 0|req: 13/24] 10.222.0.81 () {54 vars in 930 bytes} [Wed May 26 14:51:15 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:51:15.802244 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi [None req-dd96e453-01db-46b4-a2dd-199d48dde5bd admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "name": "m1.small", "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "vcpus": 1, "id": "2", "os-flavor-access:is_public": true}} {{(pid=103288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:51:15.894515 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: INFO nova.api.openstack.requestlog [None req-dd96e453-01db-46b4-a2dd-199d48dde5bd admin admin] 10.222.0.81 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.151571 May 26 14:51:15.895106 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: [pid: 103288|app: 0|req: 12/25] 10.222.0.81 () {64 vars in 1282 bytes} [Wed May 26 14:51:15 2021] POST /compute/v2.1/flavors => generated 405 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 26 14:51:15.908013 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi [None req-7ff59426-b020-4f53-9b5c-960d84533614 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:51:16.030092 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: INFO nova.api.openstack.requestlog [None req-7ff59426-b020-4f53-9b5c-960d84533614 admin admin] 10.222.0.81 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.125632 May 26 14:51:16.030606 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: [pid: 103289|app: 0|req: 14/26] 10.222.0.81 () {64 vars in 1332 bytes} [Wed May 26 14:51:15 2021] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:51:18.148429 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi [None req-dd96e453-01db-46b4-a2dd-199d48dde5bd admin admin] Calling method '>' {{(pid=103288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:51:18.149457 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: INFO nova.api.openstack.requestlog [None req-dd96e453-01db-46b4-a2dd-199d48dde5bd admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001505 May 26 14:51:18.150166 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: [pid: 103288|app: 0|req: 13/27] 10.222.0.81 () {54 vars in 930 bytes} [Wed May 26 14:51:18 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:51:18.207361 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi [None req-cdfafe99-c992-4517-8b07-efd80e4cd629 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "name": "m1.medium", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "3", "ram": 4096, "rxtx_factor": 1.0, "swap": 0, "disk": 40}} {{(pid=103289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:51:18.288319 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: INFO nova.api.openstack.requestlog [None req-cdfafe99-c992-4517-8b07-efd80e4cd629 admin admin] 10.222.0.81 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.132162 May 26 14:51:18.288868 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: [pid: 103289|app: 0|req: 15/28] 10.222.0.81 () {64 vars in 1282 bytes} [Wed May 26 14:51:18 2021] POST /compute/v2.1/flavors => generated 406 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 14:51:18.300436 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi [None req-0ae34867-9b96-4bdc-a088-b376c7bf2ba3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:51:18.395175 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: INFO nova.api.openstack.requestlog [None req-0ae34867-9b96-4bdc-a088-b376c7bf2ba3 admin admin] 10.222.0.81 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.098365 May 26 14:51:18.395986 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: [pid: 103288|app: 0|req: 14/29] 10.222.0.81 () {64 vars in 1332 bytes} [Wed May 26 14:51:18 2021] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 14:51:20.543959 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi [None req-cdfafe99-c992-4517-8b07-efd80e4cd629 admin admin] Calling method '>' {{(pid=103289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:51:20.544989 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: INFO nova.api.openstack.requestlog [None req-cdfafe99-c992-4517-8b07-efd80e4cd629 admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 May 26 14:51:20.545838 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: [pid: 103289|app: 0|req: 16/30] 10.222.0.81 () {54 vars in 930 bytes} [Wed May 26 14:51:20 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:51:20.604868 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi [None req-e9dfe2f2-3fc8-49db-ae64-1e2c68c90177 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 80, "name": "m1.large", "os-flavor-access:is_public": true, "ram": 8192, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "4", "vcpus": 4}} {{(pid=103288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:51:20.711516 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: INFO nova.api.openstack.requestlog [None req-e9dfe2f2-3fc8-49db-ae64-1e2c68c90177 admin admin] 10.222.0.81 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.160134 May 26 14:51:20.712452 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: [pid: 103288|app: 0|req: 15/31] 10.222.0.81 () {64 vars in 1282 bytes} [Wed May 26 14:51:20 2021] POST /compute/v2.1/flavors => generated 405 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 14:51:20.725058 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi [None req-0acbc5d3-f4a2-4933-ad62-9dad358135e0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:51:20.830312 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: INFO nova.api.openstack.requestlog [None req-0acbc5d3-f4a2-4933-ad62-9dad358135e0 admin admin] 10.222.0.81 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.109157 May 26 14:51:20.831230 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: [pid: 103289|app: 0|req: 17/32] 10.222.0.81 () {64 vars in 1332 bytes} [Wed May 26 14:51:20 2021] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:51:23.008153 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi [None req-e9dfe2f2-3fc8-49db-ae64-1e2c68c90177 admin admin] Calling method '>' {{(pid=103288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:51:23.009934 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: INFO nova.api.openstack.requestlog [None req-e9dfe2f2-3fc8-49db-ae64-1e2c68c90177 admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002183 May 26 14:51:23.011290 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: [pid: 103288|app: 0|req: 16/33] 10.222.0.81 () {54 vars in 930 bytes} [Wed May 26 14:51:23 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:51:23.080082 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi [None req-1e0a8d61-cd10-4df7-a699-448d7c9c37d3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 16384, "name": "m1.xlarge", "os-flavor-access:is_public": true, "disk": 160, "vcpus": 8, "id": "5", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0}} {{(pid=103289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:51:23.254705 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: INFO nova.api.openstack.requestlog [None req-1e0a8d61-cd10-4df7-a699-448d7c9c37d3 admin admin] 10.222.0.81 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.238187 May 26 14:51:23.255466 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: [pid: 103289|app: 0|req: 18/34] 10.222.0.81 () {64 vars in 1282 bytes} [Wed May 26 14:51:23 2021] POST /compute/v2.1/flavors => generated 408 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 14:51:23.267778 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi [None req-a28b1485-34d7-4876-bb05-743f7175238e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:51:23.421072 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: INFO nova.api.openstack.requestlog [None req-a28b1485-34d7-4876-bb05-743f7175238e admin admin] 10.222.0.81 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.157213 May 26 14:51:23.422379 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: [pid: 103288|app: 0|req: 17/35] 10.222.0.81 () {64 vars in 1332 bytes} [Wed May 26 14:51:23 2021] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 14:52:02.592921 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi [None req-1e0a8d61-cd10-4df7-a699-448d7c9c37d3 admin admin] Calling method '>' {{(pid=103289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:52:02.593986 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: INFO nova.api.openstack.requestlog [None req-1e0a8d61-cd10-4df7-a699-448d7c9c37d3 admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 May 26 14:52:02.594394 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: [pid: 103289|app: 0|req: 19/36] 10.222.0.81 () {54 vars in 930 bytes} [Wed May 26 14:52:02 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:52:02.651484 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi [None req-df4b5622-7787-4dbb-8573-5d277fe43f22 admin admin] Calling method '>' {{(pid=103288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:52:02.674404 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: INFO nova.api.openstack.requestlog [None req-df4b5622-7787-4dbb-8573-5d277fe43f22 admin admin] 10.222.0.81 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.073470 May 26 14:52:02.674931 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: [pid: 103288|app: 0|req: 18/37] 10.222.0.81 () {60 vars in 1291 bytes} [Wed May 26 14:52:02 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:52:04.035484 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi [None req-1e0a8d61-cd10-4df7-a699-448d7c9c37d3 admin admin] Calling method '>' {{(pid=103289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:52:04.037150 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: INFO nova.api.openstack.requestlog [None req-1e0a8d61-cd10-4df7-a699-448d7c9c37d3 admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002078 May 26 14:52:04.037558 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: [pid: 103289|app: 0|req: 20/38] 10.222.0.81 () {56 vars in 1075 bytes} [Wed May 26 14:52:04 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:52:04.222088 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi [None req-91fe711a-b39c-4cd0-9144-d2aedb4ad0b6 admin admin] Calling method '>' {{(pid=103288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:52:04.234386 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: INFO nova.api.openstack.wsgi [None req-91fe711a-b39c-4cd0-9144-d2aedb4ad0b6 admin admin] HTTP exception thrown: Flavor 42 could not be found. May 26 14:52:04.234959 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi [None req-91fe711a-b39c-4cd0-9144-d2aedb4ad0b6 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 26 14:52:04.235747 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: INFO nova.api.openstack.requestlog [None req-91fe711a-b39c-4cd0-9144-d2aedb4ad0b6 admin admin] 10.222.0.81 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.88 time: 0.064249 May 26 14:52:04.236254 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: [pid: 103288|app: 0|req: 19/39] 10.222.0.81 () {60 vars in 1191 bytes} [Wed May 26 14:52:04 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 26 14:52:04.245665 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi [None req-74fa68a4-5f74-487d-ab69-1afeac3fb767 admin admin] Calling method '>' {{(pid=103289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:52:04.266057 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: INFO nova.api.openstack.requestlog [None req-74fa68a4-5f74-487d-ab69-1afeac3fb767 admin admin] 10.222.0.81 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.024073 May 26 14:52:04.266584 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: [pid: 103289|app: 0|req: 21/40] 10.222.0.81 () {60 vars in 1211 bytes} [Wed May 26 14:52:04 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:52:04.276712 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi [None req-551ed6af-8ab9-4017-941e-cbf6463c72dc admin admin] Calling method '>' {{(pid=103288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:52:04.296530 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: INFO nova.api.openstack.requestlog [None req-551ed6af-8ab9-4017-941e-cbf6463c72dc admin admin] 10.222.0.81 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.023263 May 26 14:52:04.297059 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: [pid: 103288|app: 0|req: 20/41] 10.222.0.81 () {60 vars in 1211 bytes} [Wed May 26 14:52:04 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:52:04.306066 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi [None req-a15b0e77-7c49-4d1b-a131-440cc6f4519e admin admin] Calling method '>' {{(pid=103289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:52:04.318732 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: INFO nova.api.openstack.wsgi [None req-a15b0e77-7c49-4d1b-a131-440cc6f4519e admin admin] HTTP exception thrown: Flavor 42 could not be found. May 26 14:52:04.319317 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi [None req-a15b0e77-7c49-4d1b-a131-440cc6f4519e admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103289) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 26 14:52:04.320114 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: INFO nova.api.openstack.requestlog [None req-a15b0e77-7c49-4d1b-a131-440cc6f4519e admin admin] 10.222.0.81 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.88 time: 0.017580 May 26 14:52:04.320619 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: [pid: 103289|app: 0|req: 22/42] 10.222.0.81 () {60 vars in 1191 bytes} [Wed May 26 14:52:04 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 26 14:52:05.623388 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi [None req-551ed6af-8ab9-4017-941e-cbf6463c72dc admin admin] Calling method '>' {{(pid=103288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:52:05.624387 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: INFO nova.api.openstack.requestlog [None req-551ed6af-8ab9-4017-941e-cbf6463c72dc admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001412 May 26 14:52:05.624783 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: [pid: 103288|app: 0|req: 21/43] 10.222.0.81 () {56 vars in 1075 bytes} [Wed May 26 14:52:05 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:52:05.813756 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi [None req-c96a3112-9281-4fc3-bea7-f59ed4a1d487 admin admin] Calling method '>' {{(pid=103289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:52:05.826448 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: INFO nova.api.openstack.wsgi [None req-c96a3112-9281-4fc3-bea7-f59ed4a1d487 admin admin] HTTP exception thrown: Flavor 84 could not be found. May 26 14:52:05.827019 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi [None req-c96a3112-9281-4fc3-bea7-f59ed4a1d487 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103289) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 26 14:52:05.827810 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: INFO nova.api.openstack.requestlog [None req-c96a3112-9281-4fc3-bea7-f59ed4a1d487 admin admin] 10.222.0.81 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.88 time: 0.064403 May 26 14:52:05.828336 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: [pid: 103289|app: 0|req: 23/44] 10.222.0.81 () {60 vars in 1191 bytes} [Wed May 26 14:52:05 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 26 14:52:05.838076 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi [None req-223a7c7b-0c7e-4306-bd40-373c2f749fdd admin admin] Calling method '>' {{(pid=103288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:52:05.857821 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: INFO nova.api.openstack.requestlog [None req-223a7c7b-0c7e-4306-bd40-373c2f749fdd admin admin] 10.222.0.81 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.023196 May 26 14:52:05.858357 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: [pid: 103288|app: 0|req: 22/45] 10.222.0.81 () {60 vars in 1211 bytes} [Wed May 26 14:52:05 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:52:05.867952 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi [None req-ec595a75-23b5-420f-9033-4d3723a80eb5 admin admin] Calling method '>' {{(pid=103289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:52:05.890473 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: INFO nova.api.openstack.requestlog [None req-ec595a75-23b5-420f-9033-4d3723a80eb5 admin admin] 10.222.0.81 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.025959 May 26 14:52:05.891003 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: [pid: 103289|app: 0|req: 24/46] 10.222.0.81 () {60 vars in 1211 bytes} [Wed May 26 14:52:05 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:52:05.901004 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi [None req-3d4e78c9-bd60-4ad9-a86a-2ab94a53244c admin admin] Calling method '>' {{(pid=103288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:52:05.915769 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: INFO nova.api.openstack.wsgi [None req-3d4e78c9-bd60-4ad9-a86a-2ab94a53244c admin admin] HTTP exception thrown: Flavor 84 could not be found. May 26 14:52:05.916350 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi [None req-3d4e78c9-bd60-4ad9-a86a-2ab94a53244c admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 26 14:52:05.917148 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: INFO nova.api.openstack.requestlog [None req-3d4e78c9-bd60-4ad9-a86a-2ab94a53244c admin admin] 10.222.0.81 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.88 time: 0.019788 May 26 14:52:05.917697 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: [pid: 103288|app: 0|req: 23/47] 10.222.0.81 () {60 vars in 1191 bytes} [Wed May 26 14:52:05 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) May 26 14:52:07.217200 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi [None req-ec595a75-23b5-420f-9033-4d3723a80eb5 admin admin] Calling method '>' {{(pid=103289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:52:07.218280 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: INFO nova.api.openstack.requestlog [None req-ec595a75-23b5-420f-9033-4d3723a80eb5 admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 May 26 14:52:07.218676 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: [pid: 103289|app: 0|req: 25/48] 10.222.0.81 () {56 vars in 1075 bytes} [Wed May 26 14:52:07 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:52:07.403193 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi [None req-32653598-a4db-4c6c-a527-fd177a9cd2d1 admin admin] Calling method '>' {{(pid=103288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:52:07.415997 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: INFO nova.api.openstack.wsgi [None req-32653598-a4db-4c6c-a527-fd177a9cd2d1 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 26 14:52:07.416564 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi [None req-32653598-a4db-4c6c-a527-fd177a9cd2d1 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 26 14:52:07.417355 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: INFO nova.api.openstack.requestlog [None req-32653598-a4db-4c6c-a527-fd177a9cd2d1 admin admin] 10.222.0.81 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.88 time: 0.063424 May 26 14:52:07.417876 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: [pid: 103288|app: 0|req: 24/49] 10.222.0.81 () {60 vars in 1194 bytes} [Wed May 26 14:52:07 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 26 14:52:07.427471 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi [None req-7b47ea75-c2fb-4563-be02-209840151131 admin admin] Calling method '>' {{(pid=103289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:52:07.446738 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: INFO nova.api.openstack.requestlog [None req-7b47ea75-c2fb-4563-be02-209840151131 admin admin] 10.222.0.81 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.023332 May 26 14:52:07.447258 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: [pid: 103289|app: 0|req: 26/50] 10.222.0.81 () {60 vars in 1211 bytes} [Wed May 26 14:52:07 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 14:52:07.456650 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi [None req-b4c29454-4d9f-403b-9d26-c803cf6c1b54 admin admin] Calling method '>' {{(pid=103288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:52:07.476972 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: INFO nova.api.openstack.requestlog [None req-b4c29454-4d9f-403b-9d26-c803cf6c1b54 admin admin] 10.222.0.81 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.023876 May 26 14:52:07.477495 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: [pid: 103288|app: 0|req: 25/51] 10.222.0.81 () {60 vars in 1211 bytes} [Wed May 26 14:52:07 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:52:07.486779 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi [None req-25c77c47-f069-4590-9b3a-eab1da965448 admin admin] Calling method '>' {{(pid=103289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:52:07.499432 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: INFO nova.api.openstack.wsgi [None req-25c77c47-f069-4590-9b3a-eab1da965448 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 26 14:52:07.500012 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi [None req-25c77c47-f069-4590-9b3a-eab1da965448 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103289) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 26 14:52:07.500836 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: INFO nova.api.openstack.requestlog [None req-25c77c47-f069-4590-9b3a-eab1da965448 admin admin] 10.222.0.81 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.88 time: 0.017678 May 26 14:52:07.501349 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: [pid: 103289|app: 0|req: 27/52] 10.222.0.81 () {60 vars in 1194 bytes} [Wed May 26 14:52:07 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) May 26 14:52:08.800118 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi [None req-b4c29454-4d9f-403b-9d26-c803cf6c1b54 admin admin] Calling method '>' {{(pid=103288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:52:08.801803 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: INFO nova.api.openstack.requestlog [None req-b4c29454-4d9f-403b-9d26-c803cf6c1b54 admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 May 26 14:52:08.802208 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: [pid: 103288|app: 0|req: 26/53] 10.222.0.81 () {56 vars in 1075 bytes} [Wed May 26 14:52:08 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:52:08.989726 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi [None req-f506b0f8-b9b1-4d45-880b-c5428d445c1d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:52:09.052774 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: INFO nova.api.openstack.requestlog [None req-f506b0f8-b9b1-4d45-880b-c5428d445c1d admin admin] 10.222.0.81 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.88 time: 0.113709 May 26 14:52:09.053248 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: [pid: 103289|app: 0|req: 28/54] 10.222.0.81 () {64 vars in 1236 bytes} [Wed May 26 14:52:08 2021] POST /compute/v2.1/flavors => generated 404 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 26 14:52:10.373941 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi [None req-b4c29454-4d9f-403b-9d26-c803cf6c1b54 admin admin] Calling method '>' {{(pid=103288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:52:10.374946 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: INFO nova.api.openstack.requestlog [None req-b4c29454-4d9f-403b-9d26-c803cf6c1b54 admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 May 26 14:52:10.375343 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: [pid: 103288|app: 0|req: 27/55] 10.222.0.81 () {56 vars in 1075 bytes} [Wed May 26 14:52:10 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:52:10.563036 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi [None req-30df2f9b-e107-4747-b7c2-2178c72ad17e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:52:10.656336 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: INFO nova.api.openstack.requestlog [None req-30df2f9b-e107-4747-b7c2-2178c72ad17e admin admin] 10.222.0.81 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.88 time: 0.144723 May 26 14:52:10.656879 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: [pid: 103289|app: 0|req: 29/56] 10.222.0.81 () {64 vars in 1236 bytes} [Wed May 26 14:52:10 2021] POST /compute/v2.1/flavors => generated 405 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 14:52:11.958660 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi [None req-b4c29454-4d9f-403b-9d26-c803cf6c1b54 admin admin] Calling method '>' {{(pid=103288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:52:11.959671 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: INFO nova.api.openstack.requestlog [None req-b4c29454-4d9f-403b-9d26-c803cf6c1b54 admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002127 May 26 14:52:11.960066 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: [pid: 103288|app: 0|req: 28/57] 10.222.0.81 () {56 vars in 1075 bytes} [Wed May 26 14:52:11 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:52:12.148271 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi [None req-64309a71-266c-438d-8491-65b040ced6e7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:52:12.251710 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: INFO nova.api.openstack.requestlog [None req-64309a71-266c-438d-8491-65b040ced6e7 admin admin] 10.222.0.81 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.88 time: 0.153826 May 26 14:52:12.252197 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: [pid: 103289|app: 0|req: 30/58] 10.222.0.81 () {64 vars in 1236 bytes} [Wed May 26 14:52:12 2021] POST /compute/v2.1/flavors => generated 407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 14:52:13.547756 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi [None req-b4c29454-4d9f-403b-9d26-c803cf6c1b54 admin admin] Calling method '>' {{(pid=103288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:52:13.548772 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: INFO nova.api.openstack.requestlog [None req-b4c29454-4d9f-403b-9d26-c803cf6c1b54 admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 May 26 14:52:13.549161 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: [pid: 103288|app: 0|req: 29/59] 10.222.0.81 () {56 vars in 1075 bytes} [Wed May 26 14:52:13 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:52:13.738996 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi [None req-9549a711-6e1d-4090-8259-7e8ff84e9dcc admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:52:13.847596 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: INFO nova.api.openstack.requestlog [None req-9549a711-6e1d-4090-8259-7e8ff84e9dcc admin admin] 10.222.0.81 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.88 time: 0.158243 May 26 14:52:13.848104 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: [pid: 103289|app: 0|req: 31/60] 10.222.0.81 () {64 vars in 1236 bytes} [Wed May 26 14:52:13 2021] POST /compute/v2.1/flavors => generated 409 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 26 14:52:15.159251 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi [None req-b4c29454-4d9f-403b-9d26-c803cf6c1b54 admin admin] Calling method '>' {{(pid=103288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:52:15.160368 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: INFO nova.api.openstack.requestlog [None req-b4c29454-4d9f-403b-9d26-c803cf6c1b54 admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001403 May 26 14:52:15.160755 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: [pid: 103288|app: 0|req: 30/61] 10.222.0.81 () {56 vars in 1075 bytes} [Wed May 26 14:52:15 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:52:15.347655 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi [None req-be149eae-ffba-4544-b748-cbed96d78071 admin admin] Calling method '>' {{(pid=103289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:52:15.373027 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: INFO nova.api.openstack.requestlog [None req-be149eae-ffba-4544-b748-cbed96d78071 admin admin] 10.222.0.81 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.88 time: 0.075372 May 26 14:52:15.373576 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: [pid: 103289|app: 0|req: 32/62] 10.222.0.81 () {60 vars in 1203 bytes} [Wed May 26 14:52:15 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:52:59.403401 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi [None req-b4c29454-4d9f-403b-9d26-c803cf6c1b54 admin admin] Calling method '>' {{(pid=103288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:52:59.404401 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: INFO nova.api.openstack.requestlog [None req-b4c29454-4d9f-403b-9d26-c803cf6c1b54 admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001419 May 26 14:52:59.404791 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: [pid: 103288|app: 0|req: 31/63] 10.222.0.81 () {56 vars in 1075 bytes} [Wed May 26 14:52:59 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:52:59.592462 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi [None req-1d0211fe-bb5d-4016-a413-b347488a31b0 admin admin] Calling method '>' {{(pid=103289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:52:59.617857 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: INFO nova.api.openstack.requestlog [None req-1d0211fe-bb5d-4016-a413-b347488a31b0 admin admin] 10.222.0.81 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.88 time: 0.075620 May 26 14:52:59.618335 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: [pid: 103289|app: 0|req: 33/64] 10.222.0.81 () {60 vars in 1203 bytes} [Wed May 26 14:52:59 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:54:26.774873 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi [None req-00481945-adf2-4dde-8850-97f8bb853a32 tempest-verify_tempest_config-1379666607 tempest-verify_tempest_config-1379666607-project] Calling method '>' {{(pid=103288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:54:26.776799 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: INFO nova.api.openstack.requestlog [None req-00481945-adf2-4dde-8850-97f8bb853a32 tempest-verify_tempest_config-1379666607 tempest-verify_tempest_config-1379666607-project] 10.222.0.81 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.114864 May 26 14:54:26.777328 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: [pid: 103288|app: 0|req: 32/65] 10.222.0.81 () {58 vars in 1134 bytes} [Wed May 26 14:54:26 2021] GET /compute/v2.1/extensions => generated 22700 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 14:55:55.033632 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi [None req-1d0211fe-bb5d-4016-a413-b347488a31b0 admin admin] Calling method '>' {{(pid=103289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:55:55.034655 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: INFO nova.api.openstack.requestlog [None req-1d0211fe-bb5d-4016-a413-b347488a31b0 admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 May 26 14:55:55.035052 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: [pid: 103289|app: 0|req: 34/66] 10.222.0.81 () {56 vars in 1075 bytes} [Wed May 26 14:55:55 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:55:55.289324 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi [None req-2579a7ef-97b0-4631-8139-9ce9c3fef2fb admin admin] Calling method '>' {{(pid=103288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:55:55.290502 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 14:55:55.290502 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: warnings.warn(msg) May 26 14:55:55.292126 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG oslo_concurrency.lockutils [None req-2579a7ef-97b0-4631-8139-9ce9c3fef2fb admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:55:55.292567 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG oslo_concurrency.lockutils [None req-2579a7ef-97b0-4631-8139-9ce9c3fef2fb admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:55:55.293350 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG oslo_concurrency.lockutils [None req-2579a7ef-97b0-4631-8139-9ce9c3fef2fb admin admin] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:55:55.293803 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG oslo_concurrency.lockutils [None req-2579a7ef-97b0-4631-8139-9ce9c3fef2fb admin admin] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:55:55.330084 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: INFO nova.api.openstack.requestlog [None req-2579a7ef-97b0-4631-8139-9ce9c3fef2fb admin admin] 10.222.0.81 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.88 time: 0.158015 May 26 14:55:55.330694 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: [pid: 103288|app: 0|req: 33/67] 10.222.0.81 () {60 vars in 1194 bytes} [Wed May 26 14:55:55 2021] GET /compute/v2.1/os-services => generated 1011 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:55:56.687765 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: DEBUG nova.api.openstack.wsgi [None req-1d0211fe-bb5d-4016-a413-b347488a31b0 admin admin] Calling method '>' {{(pid=103289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:55:56.689303 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: INFO nova.api.openstack.requestlog [None req-1d0211fe-bb5d-4016-a413-b347488a31b0 admin admin] 10.222.0.81 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001946 May 26 14:55:56.689732 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: [pid: 103289|app: 0|req: 35/68] 10.222.0.81 () {56 vars in 1075 bytes} [Wed May 26 14:55:56 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:55:56.886914 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG nova.api.openstack.wsgi [None req-08ec5ad4-6c14-45b9-9548-df6c4b81c8fb admin admin] Calling method '>' {{(pid=103288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:55:56.888081 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 14:55:56.888081 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: warnings.warn(msg) May 26 14:55:56.889600 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG oslo_concurrency.lockutils [None req-08ec5ad4-6c14-45b9-9548-df6c4b81c8fb admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:55:56.890046 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG oslo_concurrency.lockutils [None req-08ec5ad4-6c14-45b9-9548-df6c4b81c8fb admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:55:56.890858 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG oslo_concurrency.lockutils [None req-08ec5ad4-6c14-45b9-9548-df6c4b81c8fb admin admin] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:55:56.891908 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: DEBUG oslo_concurrency.lockutils [None req-08ec5ad4-6c14-45b9-9548-df6c4b81c8fb admin admin] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:55:56.916959 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: INFO nova.api.openstack.requestlog [None req-08ec5ad4-6c14-45b9-9548-df6c4b81c8fb admin admin] 10.222.0.81 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.88 time: 0.084625 May 26 14:55:56.917499 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: [pid: 103288|app: 0|req: 34/69] 10.222.0.81 () {60 vars in 1194 bytes} [Wed May 26 14:55:56 2021] GET /compute/v2.1/os-services => generated 1011 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:56:49.965709 dv-cinder-784140-4-iscsi devstack@n-api.service[103287]: Wed May 26 14:56:49 2021 - graceful shutdown triggered... May 26 14:56:49.965458 dv-cinder-784140-4-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... May 26 14:56:49.966654 dv-cinder-784140-4-iscsi devstack@n-api.service[103289]: Gracefully killing worker 2 (pid: 103289)... May 26 14:56:49.967011 dv-cinder-784140-4-iscsi devstack@n-api.service[103288]: Gracefully killing worker 1 (pid: 103288)... May 26 14:56:50.966486 dv-cinder-784140-4-iscsi devstack@n-api.service[103287]: worker 1 buried after 1 seconds May 26 14:56:50.966486 dv-cinder-784140-4-iscsi devstack@n-api.service[103287]: worker 2 buried after 1 seconds May 26 14:56:50.966486 dv-cinder-784140-4-iscsi devstack@n-api.service[103287]: goodbye to uWSGI. May 26 14:56:50.968101 dv-cinder-784140-4-iscsi systemd[1]: devstack@n-api.service: Succeeded. May 26 14:56:50.968674 dv-cinder-784140-4-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. May 26 14:56:50.971552 dv-cinder-784140-4-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 26 14:56:50.986036 dv-cinder-784140-4-iscsi devstack@n-api.service[118497]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 26 14:56:50.989043 dv-cinder-784140-4-iscsi devstack@n-api.service[118497]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed May 26 14:56:50 2021] *** May 26 14:56:50.989043 dv-cinder-784140-4-iscsi devstack@n-api.service[118497]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 26 14:56:50.989043 dv-cinder-784140-4-iscsi devstack@n-api.service[118497]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 26 14:56:50.989043 dv-cinder-784140-4-iscsi devstack@n-api.service[118497]: nodename: dv-cinder-784140-4-iscsi May 26 14:56:50.989043 dv-cinder-784140-4-iscsi devstack@n-api.service[118497]: machine: x86_64 May 26 14:56:50.989043 dv-cinder-784140-4-iscsi devstack@n-api.service[118497]: clock source: unix May 26 14:56:50.989043 dv-cinder-784140-4-iscsi devstack@n-api.service[118497]: pcre jit disabled May 26 14:56:50.990134 dv-cinder-784140-4-iscsi devstack@n-api.service[118497]: detected number of CPU cores: 4 May 26 14:56:50.990134 dv-cinder-784140-4-iscsi devstack@n-api.service[118497]: current working directory: / May 26 14:56:50.990134 dv-cinder-784140-4-iscsi devstack@n-api.service[118497]: detected binary path: /usr/bin/uwsgi-core May 26 14:56:50.990134 dv-cinder-784140-4-iscsi devstack@n-api.service[118497]: your processes number limit is 47680 May 26 14:56:50.990134 dv-cinder-784140-4-iscsi devstack@n-api.service[118497]: your memory page size is 4096 bytes May 26 14:56:50.990134 dv-cinder-784140-4-iscsi devstack@n-api.service[118497]: detected max file descriptor number: 2048 May 26 14:56:50.990134 dv-cinder-784140-4-iscsi devstack@n-api.service[118497]: lock engine: pthread robust mutexes May 26 14:56:50.990134 dv-cinder-784140-4-iscsi devstack@n-api.service[118497]: thunder lock: enabled May 26 14:56:50.990134 dv-cinder-784140-4-iscsi devstack@n-api.service[118497]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 26 14:56:50.990640 dv-cinder-784140-4-iscsi devstack@n-api.service[118497]: Python version: 3.8.5 (default, Jan 27 2021, 15:41:15) [GCC 9.3.0] May 26 14:56:51.033039 dv-cinder-784140-4-iscsi devstack@n-api.service[118497]: Python main interpreter initialized at 0x56091f7a59c0 May 26 14:56:51.033039 dv-cinder-784140-4-iscsi devstack@n-api.service[118497]: python threads support enabled May 26 14:56:51.033039 dv-cinder-784140-4-iscsi devstack@n-api.service[118497]: your server socket listen backlog is limited to 100 connections May 26 14:56:51.033039 dv-cinder-784140-4-iscsi devstack@n-api.service[118497]: your mercy for graceful operations on workers is 90 seconds May 26 14:56:51.033492 dv-cinder-784140-4-iscsi devstack@n-api.service[118497]: mapped 403077 bytes (393 KB) for 2 cores May 26 14:56:51.033492 dv-cinder-784140-4-iscsi devstack@n-api.service[118497]: *** Operational MODE: preforking *** May 26 14:56:51.033788 dv-cinder-784140-4-iscsi devstack@n-api.service[118497]: *** uWSGI is running in multiple interpreter mode *** May 26 14:56:51.033788 dv-cinder-784140-4-iscsi devstack@n-api.service[118497]: spawned uWSGI master process (pid: 118497) May 26 14:56:51.033993 dv-cinder-784140-4-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 26 14:56:51.034652 dv-cinder-784140-4-iscsi devstack@n-api.service[118497]: spawned uWSGI worker 1 (pid: 118513, cores: 1) May 26 14:56:51.035465 dv-cinder-784140-4-iscsi devstack@n-api.service[118497]: spawned uWSGI worker 2 (pid: 118514, cores: 1) May 26 14:56:51.035465 dv-cinder-784140-4-iscsi devstack@n-api.service[118497]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 26 14:56:52.818914 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 14:56:52.818914 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: from cryptography.utils import int_from_bytes May 26 14:56:52.819469 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 14:56:52.819469 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: from cryptography.utils import int_from_bytes May 26 14:56:52.894433 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 14:56:52.894433 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: from cryptography.utils import int_from_bytes May 26 14:56:52.901602 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 14:56:52.901602 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: from cryptography.utils import int_from_bytes May 26 14:56:55.277095 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 26 14:56:55.277656 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 26 14:56:55.277876 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 26 14:56:55.278236 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 26 14:56:55.278753 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 26 14:56:55.279151 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.279485 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.279814 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.280152 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.280492 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.280819 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.281161 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.281490 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.281864 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.282145 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.282471 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.282810 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-784140-4-iscsi {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.283153 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.283470 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.283791 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.284127 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.284454 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.284790 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.285118 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.285653 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.286862 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.287127 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.287450 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.290529 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.290529 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.290529 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.290529 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.290529 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.290529 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.290529 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.290529 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-784140-4-iscsi {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.291142 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.291142 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.291142 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.291463 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.291784 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.292103 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.292437 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.292778 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.293085 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.293424 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.293784 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.294118 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.294456 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.294768 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.295086 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.295405 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.295738 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.296052 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.296367 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.296627 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.296940 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.297273 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.297631 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.297968 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.298227 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.298485 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.298817 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.299148 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.299573 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.299780 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.300095 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.300409 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.300721 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.301035 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.301348 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.301719 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.302053 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.302375 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.302702 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.303016 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.303347 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.303756 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.81 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.304016 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.81 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.304336 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.304685 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.305023 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.305344 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.305699 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.306031 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.309646 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.309646 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.309646 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.309646 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.309646 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.309646 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.309646 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.309646 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.310181 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.310181 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.310181 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.310181 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.310181 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.310496 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.310747 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.310867 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.311178 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.311491 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.311802 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.312117 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.312454 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.312749 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.313057 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.313386 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.313743 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.314055 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.314371 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.314683 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.314993 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.315323 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.315636 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.315946 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.316275 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.316588 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.316900 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.317254 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.317586 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.317903 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.318232 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.318540 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.318853 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.319180 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.319495 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.319807 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.320118 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.320431 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.320741 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.321054 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.321363 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.321707 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.322013 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.322411 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.322671 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.322983 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.323296 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.323608 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.323939 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.324290 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.324633 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.324987 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.325310 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.325680 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.326026 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.326353 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.326675 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.326998 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.327334 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.327654 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.327975 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.328295 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.328620 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.328947 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.329288 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.329635 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.329962 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.330288 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.330608 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.330934 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.331272 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.331608 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.331929 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.332283 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.332637 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.333533 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.334046 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.334371 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.334718 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.335053 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.335377 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.335701 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.336042 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.336394 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.336684 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.337033 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.337362 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.337717 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.338037 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.338357 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.338674 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.338989 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.339309 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.339641 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.339980 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.340301 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.340648 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.340968 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.341290 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.341646 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.341965 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.342292 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.342630 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.342940 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.343290 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.343645 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.343936 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.344268 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.344591 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.344911 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.345259 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.345573 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.345912 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.346248 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.346601 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.346939 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.347275 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.347622 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.347963 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.348280 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.349349 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.349748 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.350083 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.350415 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.350763 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.351127 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.351447 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.351768 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.352104 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.352417 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.352755 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.353085 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.353373 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.353712 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.354056 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.354378 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.354700 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.355017 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.355110 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 26 14:56:55.355517 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 26 14:56:55.355614 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.355700 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.355782 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 26 14:56:55.355979 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.356170 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 26 14:56:55.356329 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.356422 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 26 14:56:55.356654 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.356824 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.356991 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.357162 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.357320 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.357496 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.357680 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.357849 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.357996 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.358194 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.358299 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.358515 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.358615 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.358844 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.358943 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.359178 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.359271 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.359522 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.359614 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.359793 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.359885 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.360118 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.360211 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.360457 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-784140-4-iscsi {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.360548 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.360791 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.360883 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.361112 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.361210 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.361434 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.361525 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.361790 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.361893 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.362107 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.362210 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.362426 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.362518 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.362746 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.362862 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.363063 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.363268 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.363378 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.363593 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.363695 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.363909 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.364034 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.364332 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.364453 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.364657 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.364883 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.364977 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.365216 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.365315 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.365569 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.365677 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.365902 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.365995 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.366214 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.366311 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.366535 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.366627 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.366857 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.366956 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.367175 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.367266 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-784140-4-iscsi {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.367511 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.367616 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.367845 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.367943 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.368160 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.368252 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.368475 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.368618 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.368812 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.368941 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.369132 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.369263 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.369445 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.369642 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.369788 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.369957 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.370102 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.370275 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.370457 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.370617 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.370778 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.370950 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.371092 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.371282 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.371416 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.371616 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.371746 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.371931 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.372064 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.372259 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.372384 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.372576 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.372709 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.372916 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.373039 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.373236 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.373350 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.373583 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.373686 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.373861 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.373974 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.374154 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.374267 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.374494 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.374636 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.374828 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.374929 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.375166 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.375280 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.375426 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.375519 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.375684 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.375841 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.376021 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.376176 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.376358 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.376465 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.376679 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.376880 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.377053 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.377226 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.377326 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.377562 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.377673 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.378022 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.378201 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.378302 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.378519 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.378633 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.378845 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.378957 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.379176 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.379307 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.379501 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.379658 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.379873 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.380016 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.380221 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.380323 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.380623 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.380715 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.380947 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.381052 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.81 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.381264 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.381357 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.81 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.381626 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.381733 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.381923 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.382036 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.382239 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.382353 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.382561 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.382658 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.382875 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.382968 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.383189 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.383280 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.383505 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.383597 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.383827 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.383919 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.384143 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.384246 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.384454 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.384544 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.384769 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.384862 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.385083 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.385173 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.385347 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.385446 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.385695 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.385807 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.386032 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.386127 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.386347 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.386452 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.386664 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.386764 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.386983 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.387089 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.387293 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.387398 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.387602 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.387744 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.387914 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.388021 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.388231 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.388347 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.388546 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.388646 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.388863 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.388970 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.389181 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.389297 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.389494 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.389694 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.389839 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.389931 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.390154 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.390247 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.390466 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.390559 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.390798 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.390892 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.391134 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.391235 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.391449 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.391546 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.391767 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.391867 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.392082 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.392182 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.392394 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.392485 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.392725 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.392835 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.393043 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.393133 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.393357 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.393459 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.393692 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.393797 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.394012 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.394108 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.394326 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.394425 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.394656 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.394747 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.394970 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.395064 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.395829 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.395937 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.396218 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.396377 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.396539 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.396702 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.396858 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.397030 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.397178 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.397366 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.397514 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.397738 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.397926 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.398031 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.398241 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.398344 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.398561 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.398660 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.398877 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.398985 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.399280 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.399396 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.399521 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.399690 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.399837 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.399956 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.400149 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.400279 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.400470 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.400596 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.400803 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.401124 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.401442 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.401699 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.401862 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.402017 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.402171 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 14:56:55.402340 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.402516 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.402672 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.402826 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.402978 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.403136 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.403291 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.403706 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.403863 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.404015 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.404174 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.404441 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.404766 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.405112 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.405436 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.405657 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.405791 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.406087 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.406284 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.406421 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.406650 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.406779 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.407004 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.407151 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.407355 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.407483 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.407693 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.407814 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.408028 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.408159 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.408360 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.408479 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.408684 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.408803 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.409005 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.409317 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.409584 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.409736 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.409875 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.410016 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.410295 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.410446 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.410618 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.410813 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.411465 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.411786 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.412012 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.412155 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.412434 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.412565 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.412757 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.412951 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.413094 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.413415 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.413588 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.413782 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.414085 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.414218 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.414408 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.414729 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.414861 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.415055 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.415334 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.415466 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.415683 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.415880 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.416017 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.416315 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.416564 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.416696 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.416946 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.417086 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.417268 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.417615 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.417757 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.417937 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.418129 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.418263 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.418563 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.418696 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.418902 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.419050 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.419223 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.419632 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.419783 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.419915 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.420086 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.420236 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.420468 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.420600 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.420785 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.421019 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.421238 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.421696 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.421845 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.421976 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.422176 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.422313 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.422507 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.422679 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.422821 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.423119 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.423257 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.423457 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.423623 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.423758 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.424149 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.424292 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.424503 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.424635 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.424826 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.425154 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.425288 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.425472 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.425748 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.425896 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.426121 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.426363 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.426519 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.426787 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.427013 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.427243 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.427527 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.427679 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.427891 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.428023 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.428208 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.428397 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.428541 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.428855 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.428990 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.429276 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.429416 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.429620 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.429902 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.430042 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.430349 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.430483 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.430677 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.430824 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.431018 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.431292 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.431432 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.431679 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.431824 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.431995 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.432287 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.432429 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.432630 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.432796 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.432970 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.433236 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.433370 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.433642 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.433792 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.433972 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.434282 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.434423 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.434622 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.434764 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.434959 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.435292 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.435435 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.435631 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.435825 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.436061 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.436390 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.436536 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.436711 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.436977 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.437111 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.437367 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.437498 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.437729 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.437945 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.438080 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.438344 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.438620 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.438760 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.438965 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.439267 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.439400 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.439608 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.439936 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.440081 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.440263 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.440446 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.440579 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.440868 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.440999 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.441182 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.441364 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.441505 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.441845 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.441991 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.442254 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.442493 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.442675 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.442934 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.443067 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.443336 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.443476 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.443656 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.443846 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.443980 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.444302 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.444442 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.444617 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.444872 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.445074 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.445296 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.445534 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.445702 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.445927 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.446066 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.446261 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.446550 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.446691 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.446940 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.447153 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.447295 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.447596 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.447741 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.447939 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.448073 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.448254 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.448499 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.448639 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.448909 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.449048 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.449229 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.449446 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.449600 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.449899 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.450053 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.450226 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.450488 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.450653 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.450808 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.450972 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.451119 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.451264 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.455036 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.457322 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.457497 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.458265 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.458265 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.458715 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.458887 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.459040 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.459188 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.459336 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.459489 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.459655 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.459813 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.459975 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.460150 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.460355 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.460523 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.460523 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.460926 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.461074 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.461074 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.461350 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.461496 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.461496 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.461883 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.462031 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.462196 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.462196 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.462491 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.462491 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.462789 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.462935 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.462935 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.463222 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.463377 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.463613 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.463613 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.463911 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.464065 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.464224 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.464385 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.464533 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.464686 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.464839 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.464985 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.465139 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.465139 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.465426 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.465666 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.465666 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.465950 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.466096 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.466271 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.466271 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.466567 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.466714 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.466861 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.467015 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.467172 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.467329 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.467476 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.467621 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.467774 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.467930 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.468095 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.468242 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.468389 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.468560 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.468781 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.468946 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.469102 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.469257 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.469413 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.469586 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.469750 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.469913 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.470068 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.470226 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.470383 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.470383 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.470663 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.470844 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.471080 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.471080 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.471360 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.471360 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.471645 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.471800 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.471947 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.472115 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.472261 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.472415 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.472576 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.472731 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.472894 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.473040 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.473195 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.473951 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.474138 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.474288 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.474502 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.474669 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.474893 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.475056 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.475205 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.475350 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.475504 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.475659 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.475804 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.475960 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.476108 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.476260 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.476408 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.476658 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.476824 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.476981 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.477128 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.477274 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.477420 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.477593 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.477593 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.477898 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.478043 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.478188 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.478341 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.478496 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.478667 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.478905 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.479067 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.479213 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.479213 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.479510 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.479674 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.479830 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.479830 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.479830 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.480260 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.480406 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.480561 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.480726 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.480882 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.481036 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.481292 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.481517 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.481517 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.481838 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.481986 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.482139 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.482285 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.482439 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.482793 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.482952 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.483112 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.483260 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.483404 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.483560 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.483707 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.483852 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.483998 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.484143 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.484297 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.484458 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.484606 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.484751 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.484751 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.485055 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.485211 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.485358 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.485510 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.485716 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.485871 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.486023 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.486185 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.486332 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.486485 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.486630 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.486630 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.486630 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.487065 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.487220 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.487366 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.487511 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.487664 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.487822 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.487977 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.488134 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.488289 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.488443 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.488663 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.488821 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.489116 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.489327 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.489520 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.489702 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.489702 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.490004 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.490152 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.490300 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.490445 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.490591 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.490744 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.490901 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.491056 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.491056 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.491461 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.491622 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.491784 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.491933 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.492090 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.492237 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.492237 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.492515 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.492672 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.492819 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.492819 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.493106 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.493261 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.493424 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.493679 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.493835 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.493982 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.494136 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.494283 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.494428 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.494585 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.494741 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.494895 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.495051 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.495213 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.495370 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.495527 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.495684 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.495832 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.495986 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.496143 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.496289 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.496434 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.496581 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.496728 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.496888 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.497035 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.497192 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.497339 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.497484 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.497667 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.497825 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.497979 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.498133 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.498281 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.498435 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.498678 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.498828 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.498975 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.499155 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.499397 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.499563 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.499727 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.499883 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.500029 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.500182 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.500329 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.500545 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.500545 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.501206 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.502412 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.503396 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.503715 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.504648 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.504820 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.504971 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.505119 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.505437 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.505717 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.505874 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.506031 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.506187 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.506343 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.506498 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.506670 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.506829 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.506985 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.506985 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.506985 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.506985 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.506985 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.506985 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.506985 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.506985 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.508145 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.508145 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.508145 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.508145 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.508145 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.508145 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.508145 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.508145 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.509249 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.509249 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.509249 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.509249 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.509249 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.509249 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.509249 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.509249 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.510509 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.510509 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.510509 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.510509 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.510509 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.510509 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.510509 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.510509 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.511607 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.511607 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.511607 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.512037 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.512324 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.512488 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.512749 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.513071 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.513395 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.513754 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.514100 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.514405 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.514729 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.515072 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.515681 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.515860 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.516020 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.516020 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.516339 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.516486 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.516633 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.516788 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.516936 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.517092 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.517246 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.517393 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.517653 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.517998 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.518323 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.518664 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.518990 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.519896 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.519896 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.520730 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.520886 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.521046 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.521202 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.521363 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.521516 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.521721 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.521886 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.522043 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.522199 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.522495 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.522649 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.522797 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.522954 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.523109 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.523256 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.523401 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.523557 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.523703 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.523865 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.524025 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.524192 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.524434 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.524597 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.524921 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.525334 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.525707 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.525873 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.526035 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.526192 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.526349 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.526542 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.526696 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.526843 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.526998 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.527162 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.527323 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.527517 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.527676 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.527831 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.527985 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.528141 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.528302 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.528737 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.528887 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.529042 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.529373 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.529534 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.529749 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.529896 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.530150 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.530315 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.530463 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.530619 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.530814 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.530965 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.531120 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.531268 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.531423 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118514) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 26 14:56:55.531580 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.531803 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.532670 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.532670 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.536979 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.536979 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.536979 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.536979 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.536979 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.536979 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.536979 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.552579 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.552579 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.552579 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.552579 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.552579 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.552579 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.552579 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.552579 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.553819 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.553819 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.553819 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.553819 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.553819 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.553819 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.553819 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.553819 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.554341 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.554341 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.554341 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.554341 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.554341 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.554341 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.554341 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.554341 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.554918 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.554918 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.554918 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.554918 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.554918 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.554918 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.554918 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.554918 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.555399 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.555399 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.555399 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.555399 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.555399 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.555399 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.555399 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.555399 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.557196 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.557630 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.557993 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.558363 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.558727 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.559090 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.559490 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.559961 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.560476 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.560839 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.561199 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.561555 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.561911 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.562247 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.562603 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.562955 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.563295 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.563648 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.564120 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.564463 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.564800 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.565148 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.565613 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.565847 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.566176 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.566507 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.566837 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.567199 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.567610 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.567948 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.568287 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.568614 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.568946 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.569276 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.569569 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_db.sqlalchemy.engines [None req-fa006031-c60e-4ea6-85d5-efc01a703ac6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118514) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 14:56:55.569718 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.569959 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.570527 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.570888 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.571225 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.571570 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.571914 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.572240 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.572630 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.573041 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.573293 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.573647 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.573974 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.574343 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.574667 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.575007 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.575381 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.575733 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.576069 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.576423 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.576768 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.577103 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.577441 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.577813 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.578139 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.578466 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.578795 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.579117 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.579445 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.579790 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.580116 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.580513 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.580938 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.581199 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.581589 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.581936 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.582238 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.582567 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.583451 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.583780 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.584106 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.584466 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.584795 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.585150 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.585493 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.589358 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.589358 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.589358 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.589358 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.589358 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.589358 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.589358 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.589358 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.590539 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.590539 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.590539 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.590539 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.590539 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.590539 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.590539 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.592538 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.592538 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.592538 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.592538 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.592538 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.593378 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.593378 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.593378 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.593803 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.593990 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.594317 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.594663 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.595014 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.595372 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.595727 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.596063 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.596399 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.596729 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.597068 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.597452 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.597818 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.598144 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.599072 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.599386 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.599716 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.600050 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.600385 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.600715 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.601230 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.601491 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.601846 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.602177 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.602508 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.602928 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.603212 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.603549 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.603879 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.604209 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.604936 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.605074 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.605401 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.605780 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.606123 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.606717 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.607062 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.607399 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.607749 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.608115 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.608399 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.609336 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.609336 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.609336 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.609909 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.610099 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.610319 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.610655 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.611010 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.611583 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.611954 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.612286 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.612630 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.613063 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.613406 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.613649 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.623396 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.623396 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.623396 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.623396 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.623396 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.623396 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.623396 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.623396 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.624106 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.624106 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.624106 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.624106 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.624106 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.624106 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.624106 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.624106 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.624702 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.624702 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.624702 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.624702 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.624702 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.624702 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.624702 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.624702 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.625295 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.625295 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.625295 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.625295 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.625295 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.625295 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.625295 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.625295 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.625888 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.625888 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.625888 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.625888 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.625888 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.626204 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.626491 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.627058 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.627405 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.627741 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.628104 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.628484 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.628790 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.629115 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.629437 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.629870 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.630201 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.630529 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.630858 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.631187 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.631514 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.631843 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.632165 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.632492 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.632817 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.633142 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.633503 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.633862 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.634196 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.634526 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.634866 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.635193 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.635520 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.635849 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.636175 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.636507 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.636857 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.637189 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.637508 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.638024 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.638307 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.638640 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.638978 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.639301 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.639665 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.640026 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.640371 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.640715 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.641038 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.641364 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.641711 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.642042 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.642404 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.642763 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.643095 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.643436 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.643780 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.644117 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.644442 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.644776 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.645103 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.646188 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.646827 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.647287 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.647691 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.648962 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.648962 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.648962 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.648962 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.649426 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.649610 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.649996 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.656712 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.656712 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.656712 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.656712 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.656712 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.656712 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.656712 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.656712 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.657521 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.657521 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.657521 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.657521 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.657521 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.657521 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.657521 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.657521 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.658488 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.658488 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.658488 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.658488 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.658488 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.658488 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.658488 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.658488 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.659177 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.659177 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.659177 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.659484 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.659816 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.660189 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.660516 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.660922 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.661783 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.662230 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.662474 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.662819 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.663164 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.663531 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.663870 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.664219 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.664567 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 14:56:55.664823 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 26 14:56:55.698794 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_db.sqlalchemy.engines [None req-26797632-d11e-4312-8dd4-e6d4286d085a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118513) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 14:56:55.949470 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.context [None req-fa006031-c60e-4ea6-85d5-efc01a703ac6 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1138cb42-e84c-4925-8485-16faa4f9e877(cell1) {{(pid=118514) load_cells /opt/stack/nova/nova/context.py:464}} May 26 14:56:55.954151 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-fa006031-c60e-4ea6-85d5-efc01a703ac6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:56:55.955999 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-fa006031-c60e-4ea6-85d5-efc01a703ac6 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:56:55.956925 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-fa006031-c60e-4ea6-85d5-efc01a703ac6 None None] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:56:55.959948 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-fa006031-c60e-4ea6-85d5-efc01a703ac6 None None] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:56:55.986026 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_db.sqlalchemy.engines [None req-fa006031-c60e-4ea6-85d5-efc01a703ac6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118514) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 14:56:55.986860 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_db.sqlalchemy.engines [None req-fa006031-c60e-4ea6-85d5-efc01a703ac6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118514) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 14:56:56.016595 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_db.sqlalchemy.engines [None req-fa006031-c60e-4ea6-85d5-efc01a703ac6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118514) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 14:56:56.045302 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.context [None req-26797632-d11e-4312-8dd4-e6d4286d085a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1138cb42-e84c-4925-8485-16faa4f9e877(cell1) {{(pid=118513) load_cells /opt/stack/nova/nova/context.py:464}} May 26 14:56:56.049762 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-26797632-d11e-4312-8dd4-e6d4286d085a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:56:56.052007 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-26797632-d11e-4312-8dd4-e6d4286d085a None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:56:56.052926 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-26797632-d11e-4312-8dd4-e6d4286d085a None None] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:56:56.054972 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-26797632-d11e-4312-8dd4-e6d4286d085a None None] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:56:56.082173 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_db.sqlalchemy.engines [None req-26797632-d11e-4312-8dd4-e6d4286d085a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118513) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 14:56:56.089934 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_db.sqlalchemy.engines [None req-26797632-d11e-4312-8dd4-e6d4286d085a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118513) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 14:56:56.118437 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_db.sqlalchemy.engines [None req-26797632-d11e-4312-8dd4-e6d4286d085a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118513) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 14:56:56.348040 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: WARNING keystonemiddleware.auth_token [None req-fa006031-c60e-4ea6-85d5-efc01a703ac6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 26 14:56:56.354793 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: WARNING keystonemiddleware.auth_token [None req-fa006031-c60e-4ea6-85d5-efc01a703ac6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 26 14:56:56.445865 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: WARNING keystonemiddleware.auth_token [None req-26797632-d11e-4312-8dd4-e6d4286d085a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 26 14:56:56.452545 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: WARNING keystonemiddleware.auth_token [None req-26797632-d11e-4312-8dd4-e6d4286d085a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 26 14:56:56.587878 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: WARNING keystonemiddleware.auth_token [None req-fa006031-c60e-4ea6-85d5-efc01a703ac6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 26 14:56:56.593243 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: WARNING keystonemiddleware.auth_token [None req-fa006031-c60e-4ea6-85d5-efc01a703ac6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 26 14:56:56.599293 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x56091f7a59c0 pid: 118514 (default app) May 26 14:56:56.684742 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: WARNING keystonemiddleware.auth_token [None req-26797632-d11e-4312-8dd4-e6d4286d085a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 26 14:56:56.690099 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: WARNING keystonemiddleware.auth_token [None req-26797632-d11e-4312-8dd4-e6d4286d085a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 26 14:56:56.695478 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x56091f7a59c0 pid: 118513 (default app) May 26 14:57:30.909136 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-70abaf62-89fd-40ad-9bb2-702852b81670 tempest-VolumesSnapshotsTestJSON-816552212 tempest-VolumesSnapshotsTestJSON-816552212-project] Action: 'create', calling method: .version_select at 0x7f442019caf0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-63736106"}} {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:57:31.149181 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-5f46d654-d5cf-4acc-a339-14e19308a926 tempest-VolumesGetTestJSON-1492919946 tempest-VolumesGetTestJSON-1492919946-project] Action: 'create', calling method: .version_select at 0x7f442019c940>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1942718509", "metadata": {"Type": "work"}}} {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:57:32.554312 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-70abaf62-89fd-40ad-9bb2-702852b81670 tempest-VolumesSnapshotsTestJSON-816552212 tempest-VolumesSnapshotsTestJSON-816552212-project] 10.222.0.81 "POST /compute/v2.1/os-volumes" status: 200 len: 343 microversion: 2.1 time: 3.286621 May 26 14:57:32.560769 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 1/1] 10.222.0.81 () {60 vars in 1155 bytes} [Wed May 26 14:57:29 2021] POST /compute/v2.1/os-volumes => generated 343 bytes in 3289 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 26 14:57:32.743506 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-6be8d8e4-e392-46c7-9f97-8d8042603b09 tempest-VolumesNegativeTest-1245884704 tempest-VolumesNegativeTest-1245884704-project] Action: 'create', calling method: .version_select at 0x7f441f8c5c10>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1944089320", "metadata": {"Type": "work"}}} {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:57:32.744983 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-5f46d654-d5cf-4acc-a339-14e19308a926 tempest-VolumesGetTestJSON-1492919946 tempest-VolumesGetTestJSON-1492919946-project] 10.222.0.81 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 3.041877 May 26 14:57:32.746093 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 1/2] 10.222.0.81 () {60 vars in 1156 bytes} [Wed May 26 14:57:29 2021] POST /compute/v2.1/os-volumes => generated 353 bytes in 3045 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) May 26 14:57:32.751310 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-6be8d8e4-e392-46c7-9f97-8d8042603b09 tempest-VolumesNegativeTest-1245884704 tempest-VolumesNegativeTest-1245884704-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=118514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 26 14:57:32.752148 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-6be8d8e4-e392-46c7-9f97-8d8042603b09 tempest-VolumesNegativeTest-1245884704 tempest-VolumesNegativeTest-1245884704-project] 10.222.0.81 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.195256 May 26 14:57:32.754226 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-b12fb28e-cb57-4866-a661-0550f42f9b2b tempest-VolumesSnapshotsTestJSON-816552212 tempest-VolumesSnapshotsTestJSON-816552212-project] Calling method '.version_select at 0x7f441f7814c0>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:57:32.762135 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 2/3] 10.222.0.81 () {60 vars in 1156 bytes} [Wed May 26 14:57:32 2021] POST /compute/v2.1/os-volumes => generated 127 bytes in 206 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 26 14:57:32.767118 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-4b2d3e5d-59db-4594-bc94-24f313abcc15 tempest-VolumesGetTestJSON-1492919946 tempest-VolumesGetTestJSON-1492919946-project] Calling method '.version_select at 0x7f442015dc10>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:57:32.901854 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-b12fb28e-cb57-4866-a661-0550f42f9b2b tempest-VolumesSnapshotsTestJSON-816552212 tempest-VolumesSnapshotsTestJSON-816552212-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/5b9af6e1-7015-47a5-b75c-6a3542c33a14" status: 200 len: 343 microversion: 2.1 time: 0.154593 May 26 14:57:32.902905 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 2/4] 10.222.0.81 () {58 vars in 1245 bytes} [Wed May 26 14:57:32 2021] GET /compute/v2.1/os-volumes/5b9af6e1-7015-47a5-b75c-6a3542c33a14 => generated 343 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:57:32.912548 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-8e92dd36-380a-424f-bc91-16a36a06a258 tempest-VolumesNegativeTest-1245884704 tempest-VolumesNegativeTest-1245884704-project] Action: 'create', calling method: .version_select at 0x7f441f781e50>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1060348025", "metadata": {"Type": "work"}}} {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:57:32.915513 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-8e92dd36-380a-424f-bc91-16a36a06a258 tempest-VolumesNegativeTest-1245884704 tempest-VolumesNegativeTest-1245884704-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=118513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 26 14:57:32.916931 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-8e92dd36-380a-424f-bc91-16a36a06a258 tempest-VolumesNegativeTest-1245884704 tempest-VolumesNegativeTest-1245884704-project] 10.222.0.81 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.012035 May 26 14:57:32.921706 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 3/5] 10.222.0.81 () {60 vars in 1156 bytes} [Wed May 26 14:57:32 2021] POST /compute/v2.1/os-volumes => generated 125 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 26 14:57:32.930987 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-30f83d35-bfc4-4b9b-bea5-338689d4122e tempest-VolumesNegativeTest-1245884704 tempest-VolumesNegativeTest-1245884704-project] Action: 'create', calling method: .version_select at 0x7f441f781820>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1702534295", "metadata": {"Type": "work"}}} {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:57:32.932257 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-30f83d35-bfc4-4b9b-bea5-338689d4122e tempest-VolumesNegativeTest-1245884704 tempest-VolumesNegativeTest-1245884704-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=118513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 26 14:57:32.933375 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-30f83d35-bfc4-4b9b-bea5-338689d4122e tempest-VolumesNegativeTest-1245884704 tempest-VolumesNegativeTest-1245884704-project] 10.222.0.81 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.007043 May 26 14:57:32.938309 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 4/6] 10.222.0.81 () {60 vars in 1156 bytes} [Wed May 26 14:57:32 2021] POST /compute/v2.1/os-volumes => generated 121 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 26 14:57:32.944439 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-6362bb52-c02c-48d0-940e-f77fe684aa98 tempest-VolumesNegativeTest-1245884704 tempest-VolumesNegativeTest-1245884704-project] Calling method '.version_select at 0x7f441f795b80>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:57:32.956290 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-4b2d3e5d-59db-4594-bc94-24f313abcc15 tempest-VolumesGetTestJSON-1492919946 tempest-VolumesGetTestJSON-1492919946-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/2b1f4d19-dc3a-482b-8b5d-8af08613ccb8" status: 200 len: 353 microversion: 2.1 time: 0.192988 May 26 14:57:32.957776 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 3/7] 10.222.0.81 () {58 vars in 1245 bytes} [Wed May 26 14:57:32 2021] GET /compute/v2.1/os-volumes/2b1f4d19-dc3a-482b-8b5d-8af08613ccb8 => generated 353 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:57:33.012843 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.wsgi [None req-6362bb52-c02c-48d0-940e-f77fe684aa98 tempest-VolumesNegativeTest-1245884704 tempest-VolumesNegativeTest-1245884704-project] HTTP exception thrown: Volume tempest-invalid-1340299769 could not be found. May 26 14:57:33.013535 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-6362bb52-c02c-48d0-940e-f77fe684aa98 tempest-VolumesNegativeTest-1245884704 tempest-VolumesNegativeTest-1245884704-project] Returning 404 to user: Volume tempest-invalid-1340299769 could not be found. {{(pid=118513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 26 14:57:33.014489 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-6362bb52-c02c-48d0-940e-f77fe684aa98 tempest-VolumesNegativeTest-1245884704 tempest-VolumesNegativeTest-1245884704-project] 10.222.0.81 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1340299769" status: 404 len: 99 microversion: 2.1 time: 0.074066 May 26 14:57:33.015171 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 5/8] 10.222.0.81 () {58 vars in 1218 bytes} [Wed May 26 14:57:32 2021] DELETE /compute/v2.1/os-volumes/tempest-invalid-1340299769 => generated 99 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 26 14:57:33.024595 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-acc0a632-f5f6-45ec-85bf-fe5cd883e1cf tempest-VolumesNegativeTest-1245884704 tempest-VolumesNegativeTest-1245884704-project] 10.222.0.81 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003650 May 26 14:57:33.025088 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 4/9] 10.222.0.81 () {58 vars in 1140 bytes} [Wed May 26 14:57:33 2021] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 26 14:57:33.033730 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-e1ae0753-c6cc-468b-af63-5e88c127862c tempest-VolumesNegativeTest-1245884704 tempest-VolumesNegativeTest-1245884704-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003570 May 26 14:57:33.034347 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 6/10] 10.222.0.81 () {58 vars in 1137 bytes} [Wed May 26 14:57:33 2021] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 26 14:57:33.044861 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-d199fb62-ac7b-4058-b80a-da7a317ad5e1 tempest-VolumesNegativeTest-1245884704 tempest-VolumesNegativeTest-1245884704-project] Calling method '.version_select at 0x7f441f780670>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:57:33.105899 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.wsgi [None req-d199fb62-ac7b-4058-b80a-da7a317ad5e1 tempest-VolumesNegativeTest-1245884704 tempest-VolumesNegativeTest-1245884704-project] HTTP exception thrown: Volume 20373dfa-cefb-4297-a2db-952031b98a8a could not be found. May 26 14:57:33.106840 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-d199fb62-ac7b-4058-b80a-da7a317ad5e1 tempest-VolumesNegativeTest-1245884704 tempest-VolumesNegativeTest-1245884704-project] Returning 404 to user: Volume 20373dfa-cefb-4297-a2db-952031b98a8a could not be found. {{(pid=118514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 26 14:57:33.107766 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-d199fb62-ac7b-4058-b80a-da7a317ad5e1 tempest-VolumesNegativeTest-1245884704 tempest-VolumesNegativeTest-1245884704-project] 10.222.0.81 "DELETE /compute/v2.1/os-volumes/20373dfa-cefb-4297-a2db-952031b98a8a" status: 404 len: 109 microversion: 2.1 time: 0.067832 May 26 14:57:33.108379 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 5/11] 10.222.0.81 () {58 vars in 1248 bytes} [Wed May 26 14:57:33 2021] DELETE /compute/v2.1/os-volumes/20373dfa-cefb-4297-a2db-952031b98a8a => generated 109 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 26 14:57:33.118098 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-8b4688a8-85be-4c4b-828f-e01314422fd8 tempest-VolumesNegativeTest-1245884704 tempest-VolumesNegativeTest-1245884704-project] Calling method '.version_select at 0x7f441f8c7c10>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:57:33.195549 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.wsgi [None req-8b4688a8-85be-4c4b-828f-e01314422fd8 tempest-VolumesNegativeTest-1245884704 tempest-VolumesNegativeTest-1245884704-project] HTTP exception thrown: Volume e7ca9dd2-3473-4ece-b1cd-944a585017e0 could not be found. May 26 14:57:33.196721 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-8b4688a8-85be-4c4b-828f-e01314422fd8 tempest-VolumesNegativeTest-1245884704 tempest-VolumesNegativeTest-1245884704-project] Returning 404 to user: Volume e7ca9dd2-3473-4ece-b1cd-944a585017e0 could not be found. {{(pid=118513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 26 14:57:33.197795 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-8b4688a8-85be-4c4b-828f-e01314422fd8 tempest-VolumesNegativeTest-1245884704 tempest-VolumesNegativeTest-1245884704-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/e7ca9dd2-3473-4ece-b1cd-944a585017e0" status: 404 len: 109 microversion: 2.1 time: 0.083879 May 26 14:57:33.198661 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 7/12] 10.222.0.81 () {58 vars in 1245 bytes} [Wed May 26 14:57:33 2021] GET /compute/v2.1/os-volumes/e7ca9dd2-3473-4ece-b1cd-944a585017e0 => generated 109 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 14:57:33.916192 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-62493589-0b3d-4433-8252-9c6b892919bb tempest-VolumesSnapshotsTestJSON-816552212 tempest-VolumesSnapshotsTestJSON-816552212-project] Calling method '.version_select at 0x7f441f8c5c10>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:57:33.971514 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-57254be0-55d2-4031-b133-4dccb41d0a71 tempest-VolumesGetTestJSON-1492919946 tempest-VolumesGetTestJSON-1492919946-project] Calling method '.version_select at 0x7f441f795550>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:57:34.048856 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-62493589-0b3d-4433-8252-9c6b892919bb tempest-VolumesSnapshotsTestJSON-816552212 tempest-VolumesSnapshotsTestJSON-816552212-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/5b9af6e1-7015-47a5-b75c-6a3542c33a14" status: 200 len: 344 microversion: 2.1 time: 0.136988 May 26 14:57:34.049750 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 6/13] 10.222.0.81 () {58 vars in 1245 bytes} [Wed May 26 14:57:33 2021] GET /compute/v2.1/os-volumes/5b9af6e1-7015-47a5-b75c-6a3542c33a14 => generated 344 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:57:34.063444 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-d34622f2-6630-49dd-a73b-037ac2ed9ec2 tempest-VolumesSnapshotsTestJSON-816552212 tempest-VolumesSnapshotsTestJSON-816552212-project] Action: 'create', calling method: .version_select at 0x7f442015ddc0>, body: {"snapshot": {"volume_id": "5b9af6e1-7015-47a5-b75c-6a3542c33a14", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-116763462"}} {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:57:34.139065 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-57254be0-55d2-4031-b133-4dccb41d0a71 tempest-VolumesGetTestJSON-1492919946 tempest-VolumesGetTestJSON-1492919946-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/2b1f4d19-dc3a-482b-8b5d-8af08613ccb8" status: 200 len: 354 microversion: 2.1 time: 0.171606 May 26 14:57:34.140246 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 8/14] 10.222.0.81 () {58 vars in 1245 bytes} [Wed May 26 14:57:33 2021] GET /compute/v2.1/os-volumes/2b1f4d19-dc3a-482b-8b5d-8af08613ccb8 => generated 354 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:57:34.151769 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-3c335cc2-295a-458c-9964-d80fdb314154 tempest-VolumesGetTestJSON-1492919946 tempest-VolumesGetTestJSON-1492919946-project] Calling method '.version_select at 0x7f441f7950d0>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:57:34.296845 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-3c335cc2-295a-458c-9964-d80fdb314154 tempest-VolumesGetTestJSON-1492919946 tempest-VolumesGetTestJSON-1492919946-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/2b1f4d19-dc3a-482b-8b5d-8af08613ccb8" status: 200 len: 354 microversion: 2.1 time: 0.148722 May 26 14:57:34.297954 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 9/15] 10.222.0.81 () {58 vars in 1245 bytes} [Wed May 26 14:57:34 2021] GET /compute/v2.1/os-volumes/2b1f4d19-dc3a-482b-8b5d-8af08613ccb8 => generated 354 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 14:57:34.470185 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-2a0d743e-dab1-485b-9120-aa1a52e823f7 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-287663221", "imageRef": "dcacad62-e278-4869-aa20-e5df07dd03db", "flavorRef": "452", "networks": [{"uuid": "fc8154d0-713e-4031-a1fb-bb0dd6440711"}]}} {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:57:34.673056 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.network.neutron [None req-2a0d743e-dab1-485b-9120-aa1a52e823f7 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] validate_networks() for [('fc8154d0-713e-4031-a1fb-bb0dd6440711', None, None, None)] {{(pid=118513) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} May 26 14:57:34.843341 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-d34622f2-6630-49dd-a73b-037ac2ed9ec2 tempest-VolumesSnapshotsTestJSON-816552212 tempest-VolumesSnapshotsTestJSON-816552212-project] 10.222.0.81 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.784332 May 26 14:57:34.843685 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 7/16] 10.222.0.81 () {60 vars in 1162 bytes} [Wed May 26 14:57:34 2021] POST /compute/v2.1/os-snapshots => generated 286 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 14:57:34.853087 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-75308462-4953-4380-a47b-089e367ef631 tempest-VolumesGetTestJSON-1492919946 tempest-VolumesGetTestJSON-1492919946-project] Calling method '.version_select at 0x7f441f798a60>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:57:35.125100 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-75308462-4953-4380-a47b-089e367ef631 tempest-VolumesGetTestJSON-1492919946 tempest-VolumesGetTestJSON-1492919946-project] 10.222.0.81 "DELETE /compute/v2.1/os-volumes/2b1f4d19-dc3a-482b-8b5d-8af08613ccb8" status: 202 len: 0 microversion: 2.1 time: 0.280167 May 26 14:57:35.129155 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 8/17] 10.222.0.81 () {58 vars in 1248 bytes} [Wed May 26 14:57:34 2021] DELETE /compute/v2.1/os-volumes/2b1f4d19-dc3a-482b-8b5d-8af08613ccb8 => generated 0 bytes in 282 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 14:57:35.133870 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-8ca21634-1fc8-438b-9c87-f13c7affaad2 tempest-VolumesSnapshotsTestJSON-816552212 tempest-VolumesSnapshotsTestJSON-816552212-project] Calling method '.version_select at 0x7f441f71e160>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:57:35.224266 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-8ca21634-1fc8-438b-9c87-f13c7affaad2 tempest-VolumesSnapshotsTestJSON-816552212 tempest-VolumesSnapshotsTestJSON-816552212-project] 10.222.0.81 "GET /compute/v2.1/os-snapshots/647c2b7b-265a-4fe7-a321-f3e116bf3140" status: 200 len: 286 microversion: 2.1 time: 0.094667 May 26 14:57:35.225510 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 9/18] 10.222.0.81 () {58 vars in 1251 bytes} [Wed May 26 14:57:35 2021] GET /compute/v2.1/os-snapshots/647c2b7b-265a-4fe7-a321-f3e116bf3140 => generated 286 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:57:35.231757 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-8b6906bd-7453-41cb-9c46-2ce681c66a25 tempest-VolumesGetTestJSON-1492919946 tempest-VolumesGetTestJSON-1492919946-project] Calling method '.version_select at 0x7f441f798a60>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:57:35.359578 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-8b6906bd-7453-41cb-9c46-2ce681c66a25 tempest-VolumesGetTestJSON-1492919946 tempest-VolumesGetTestJSON-1492919946-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/2b1f4d19-dc3a-482b-8b5d-8af08613ccb8" status: 200 len: 353 microversion: 2.1 time: 0.132579 May 26 14:57:35.361323 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 10/19] 10.222.0.81 () {58 vars in 1245 bytes} [Wed May 26 14:57:35 2021] GET /compute/v2.1/os-volumes/2b1f4d19-dc3a-482b-8b5d-8af08613ccb8 => generated 353 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:57:35.370451 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-f15a51ab-eea9-43e4-974d-b0b74389a02f tempest-VolumesSnapshotsTestJSON-816552212 tempest-VolumesSnapshotsTestJSON-816552212-project] Calling method '.version_select at 0x7f441f798040>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:57:35.458460 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-f15a51ab-eea9-43e4-974d-b0b74389a02f tempest-VolumesSnapshotsTestJSON-816552212 tempest-VolumesSnapshotsTestJSON-816552212-project] 10.222.0.81 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.096747 May 26 14:57:35.459337 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 11/20] 10.222.0.81 () {58 vars in 1140 bytes} [Wed May 26 14:57:35 2021] GET /compute/v2.1/os-snapshots => generated 289 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:57:35.477368 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-ad02acf8-8f00-48a8-80fc-3ccee41d3dcb tempest-VolumesSnapshotsTestJSON-816552212 tempest-VolumesSnapshotsTestJSON-816552212-project] Calling method '.version_select at 0x7f441f8c5d30>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:57:35.550447 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-ad02acf8-8f00-48a8-80fc-3ccee41d3dcb tempest-VolumesSnapshotsTestJSON-816552212 tempest-VolumesSnapshotsTestJSON-816552212-project] 10.222.0.81 "GET /compute/v2.1/os-snapshots/647c2b7b-265a-4fe7-a321-f3e116bf3140" status: 200 len: 286 microversion: 2.1 time: 0.082218 May 26 14:57:35.550447 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 12/21] 10.222.0.81 () {58 vars in 1251 bytes} [Wed May 26 14:57:35 2021] GET /compute/v2.1/os-snapshots/647c2b7b-265a-4fe7-a321-f3e116bf3140 => generated 286 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:57:36.049989 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.virt.hardware [None req-2a0d743e-dab1-485b-9120-aa1a52e823f7 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Flavor limits 0:0:0 {{(pid=118513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} May 26 14:57:36.052514 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.virt.hardware [None req-2a0d743e-dab1-485b-9120-aa1a52e823f7 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Image limits 0:0:0 {{(pid=118513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} May 26 14:57:36.054337 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.virt.hardware [None req-2a0d743e-dab1-485b-9120-aa1a52e823f7 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Flavor pref 0:0:0 {{(pid=118513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} May 26 14:57:36.054950 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.virt.hardware [None req-2a0d743e-dab1-485b-9120-aa1a52e823f7 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Image pref 0:0:0 {{(pid=118513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} May 26 14:57:36.056919 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.virt.hardware [None req-2a0d743e-dab1-485b-9120-aa1a52e823f7 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} May 26 14:57:36.086173 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-2a0d743e-dab1-485b-9120-aa1a52e823f7 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:57:36.087248 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-2a0d743e-dab1-485b-9120-aa1a52e823f7 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:57:36.088238 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-2a0d743e-dab1-485b-9120-aa1a52e823f7 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:57:36.089518 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-2a0d743e-dab1-485b-9120-aa1a52e823f7 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:57:36.122181 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.quota [None req-2a0d743e-dab1-485b-9120-aa1a52e823f7 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Getting quotas for project e0f665681e524725b9abb121531f47a5. Resources: {'instances', 'ram', 'cores'} {{(pid=118513) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 26 14:57:36.129969 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.quota [None req-2a0d743e-dab1-485b-9120-aa1a52e823f7 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Getting quotas for user 2d6fb430257a489c8b8a1890ecb5ea93 and project e0f665681e524725b9abb121531f47a5. Resources: {'instances', 'ram', 'cores'} {{(pid=118513) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 26 14:57:36.146593 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-2a0d743e-dab1-485b-9120-aa1a52e823f7 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Going to run 1 instances... {{(pid=118513) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 26 14:57:36.149465 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-2a0d743e-dab1-485b-9120-aa1a52e823f7 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] [instance: 2b37b708-5d64-4e1f-9e17-32f528641ca5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dcacad62-e278-4869-aa20-e5df07dd03db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118513) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} May 26 14:57:36.337239 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-2a0d743e-dab1-485b-9120-aa1a52e823f7 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.038001 May 26 14:57:36.338129 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 10/22] 10.222.0.81 () {60 vars in 1147 bytes} [Wed May 26 14:57:34 2021] POST /compute/v2.1/servers => generated 380 bytes in 2039 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 14:57:36.348038 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-d9ff0ee7-d6ad-48c2-a906-0d00d9596b9b tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:57:36.348957 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-d9ff0ee7-d6ad-48c2-a906-0d00d9596b9b tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] [instance: 2b37b708-5d64-4e1f-9e17-32f528641ca5] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:57:36.374719 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-1dc7f9b0-4b66-4cb5-8caa-132a6a3e4d7b tempest-VolumesGetTestJSON-1492919946 tempest-VolumesGetTestJSON-1492919946-project] Calling method '.version_select at 0x7f441f66b280>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:57:36.562123 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-1dc7f9b0-4b66-4cb5-8caa-132a6a3e4d7b tempest-VolumesGetTestJSON-1492919946 tempest-VolumesGetTestJSON-1492919946-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/2b1f4d19-dc3a-482b-8b5d-8af08613ccb8" status: 200 len: 353 microversion: 2.1 time: 0.192654 May 26 14:57:36.562963 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 11/23] 10.222.0.81 () {58 vars in 1245 bytes} [Wed May 26 14:57:36 2021] GET /compute/v2.1/os-volumes/2b1f4d19-dc3a-482b-8b5d-8af08613ccb8 => generated 353 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:57:36.570241 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-ed6d3ba6-5334-470e-80b2-3f1cbdf16c06 tempest-VolumesSnapshotsTestJSON-816552212 tempest-VolumesSnapshotsTestJSON-816552212-project] Calling method '.version_select at 0x7f441f66bee0>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:57:36.639434 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-d9ff0ee7-d6ad-48c2-a906-0d00d9596b9b tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d6fb430257a489c8b8a1890ecb5ea93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f665681e524725b9abb121531f47a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:57:36.642539 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-ed6d3ba6-5334-470e-80b2-3f1cbdf16c06 tempest-VolumesSnapshotsTestJSON-816552212 tempest-VolumesSnapshotsTestJSON-816552212-project] 10.222.0.81 "GET /compute/v2.1/os-snapshots/647c2b7b-265a-4fe7-a321-f3e116bf3140" status: 200 len: 286 microversion: 2.1 time: 0.078433 May 26 14:57:36.643599 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 12/24] 10.222.0.81 () {58 vars in 1251 bytes} [Wed May 26 14:57:36 2021] GET /compute/v2.1/os-snapshots/647c2b7b-265a-4fe7-a321-f3e116bf3140 => generated 286 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:57:36.661603 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-d9ff0ee7-d6ad-48c2-a906-0d00d9596b9b tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] 10.222.0.81 "GET /compute/v2.1/servers/2b37b708-5d64-4e1f-9e17-32f528641ca5" status: 200 len: 1214 microversion: 2.1 time: 0.316945 May 26 14:57:36.674453 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 13/25] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:57:36 2021] GET /compute/v2.1/servers/2b37b708-5d64-4e1f-9e17-32f528641ca5 => generated 1214 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:57:37.580887 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-aa63220f-b7a3-45ab-8561-26ab45d72d3e tempest-VolumesGetTestJSON-1492919946 tempest-VolumesGetTestJSON-1492919946-project] Calling method '.version_select at 0x7f441f795940>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:57:37.657771 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-eb1687eb-0a94-4622-9959-74ca22bed0c5 tempest-VolumesSnapshotsTestJSON-816552212 tempest-VolumesSnapshotsTestJSON-816552212-project] Calling method '.version_select at 0x7f441f780ca0>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:57:37.765221 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-aa63220f-b7a3-45ab-8561-26ab45d72d3e tempest-VolumesGetTestJSON-1492919946 tempest-VolumesGetTestJSON-1492919946-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/2b1f4d19-dc3a-482b-8b5d-8af08613ccb8" status: 200 len: 353 microversion: 2.1 time: 0.188808 May 26 14:57:37.777744 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 13/26] 10.222.0.81 () {58 vars in 1245 bytes} [Wed May 26 14:57:37 2021] GET /compute/v2.1/os-volumes/2b1f4d19-dc3a-482b-8b5d-8af08613ccb8 => generated 353 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 14:57:37.793251 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-5526715a-6f0e-4f5f-bfe5-6f15768ae713 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:57:37.795218 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-5526715a-6f0e-4f5f-bfe5-6f15768ae713 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] [instance: 2b37b708-5d64-4e1f-9e17-32f528641ca5] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:57:37.799418 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-eb1687eb-0a94-4622-9959-74ca22bed0c5 tempest-VolumesSnapshotsTestJSON-816552212 tempest-VolumesSnapshotsTestJSON-816552212-project] 10.222.0.81 "GET /compute/v2.1/os-snapshots/647c2b7b-265a-4fe7-a321-f3e116bf3140" status: 200 len: 286 microversion: 2.1 time: 0.145108 May 26 14:57:37.799987 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 14/27] 10.222.0.81 () {58 vars in 1251 bytes} [Wed May 26 14:57:37 2021] GET /compute/v2.1/os-snapshots/647c2b7b-265a-4fe7-a321-f3e116bf3140 => generated 286 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 14:57:38.014192 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-5526715a-6f0e-4f5f-bfe5-6f15768ae713 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d6fb430257a489c8b8a1890ecb5ea93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f665681e524725b9abb121531f47a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:57:38.036889 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-5526715a-6f0e-4f5f-bfe5-6f15768ae713 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] 10.222.0.81 "GET /compute/v2.1/servers/2b37b708-5d64-4e1f-9e17-32f528641ca5" status: 200 len: 1214 microversion: 2.1 time: 0.256783 May 26 14:57:38.047606 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 14/28] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:57:37 2021] GET /compute/v2.1/servers/2b37b708-5d64-4e1f-9e17-32f528641ca5 => generated 1214 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:57:38.784436 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-76359a7e-fca9-41b3-8f3c-cdfae87fc11b tempest-VolumesGetTestJSON-1492919946 tempest-VolumesGetTestJSON-1492919946-project] Calling method '.version_select at 0x7f441f71eb80>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:57:38.811604 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-17cc3b9a-e109-41d9-a805-61dcae18595e tempest-VolumesSnapshotsTestJSON-816552212 tempest-VolumesSnapshotsTestJSON-816552212-project] Calling method '.version_select at 0x7f441f683430>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:57:38.945470 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-17cc3b9a-e109-41d9-a805-61dcae18595e tempest-VolumesSnapshotsTestJSON-816552212 tempest-VolumesSnapshotsTestJSON-816552212-project] 10.222.0.81 "GET /compute/v2.1/os-snapshots/647c2b7b-265a-4fe7-a321-f3e116bf3140" status: 200 len: 287 microversion: 2.1 time: 0.137365 May 26 14:57:38.946377 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 15/29] 10.222.0.81 () {58 vars in 1251 bytes} [Wed May 26 14:57:38 2021] GET /compute/v2.1/os-snapshots/647c2b7b-265a-4fe7-a321-f3e116bf3140 => generated 287 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:57:38.958042 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-eac37b1a-8717-4240-9df7-dd00f31600a2 tempest-VolumesSnapshotsTestJSON-816552212 tempest-VolumesSnapshotsTestJSON-816552212-project] Calling method '.version_select at 0x7f441f795dc0>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:57:39.032920 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.wsgi [None req-76359a7e-fca9-41b3-8f3c-cdfae87fc11b tempest-VolumesGetTestJSON-1492919946 tempest-VolumesGetTestJSON-1492919946-project] HTTP exception thrown: Volume 2b1f4d19-dc3a-482b-8b5d-8af08613ccb8 could not be found. May 26 14:57:39.033858 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-76359a7e-fca9-41b3-8f3c-cdfae87fc11b tempest-VolumesGetTestJSON-1492919946 tempest-VolumesGetTestJSON-1492919946-project] Returning 404 to user: Volume 2b1f4d19-dc3a-482b-8b5d-8af08613ccb8 could not be found. {{(pid=118514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 26 14:57:39.035519 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-76359a7e-fca9-41b3-8f3c-cdfae87fc11b tempest-VolumesGetTestJSON-1492919946 tempest-VolumesGetTestJSON-1492919946-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/2b1f4d19-dc3a-482b-8b5d-8af08613ccb8" status: 404 len: 109 microversion: 2.1 time: 0.254121 May 26 14:57:39.037129 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 15/30] 10.222.0.81 () {58 vars in 1245 bytes} [Wed May 26 14:57:38 2021] GET /compute/v2.1/os-volumes/2b1f4d19-dc3a-482b-8b5d-8af08613ccb8 => generated 109 bytes in 257 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 14:57:39.055452 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-e3b4610b-d33c-4df8-88cd-5600d19192fb tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:57:39.056475 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-e3b4610b-d33c-4df8-88cd-5600d19192fb tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] [instance: 2b37b708-5d64-4e1f-9e17-32f528641ca5] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:57:39.076414 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-e3b4610b-d33c-4df8-88cd-5600d19192fb tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:57:39.077112 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-e3b4610b-d33c-4df8-88cd-5600d19192fb tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:57:39.078577 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-e3b4610b-d33c-4df8-88cd-5600d19192fb tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:57:39.084142 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-e3b4610b-d33c-4df8-88cd-5600d19192fb tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:57:39.301624 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-eac37b1a-8717-4240-9df7-dd00f31600a2 tempest-VolumesSnapshotsTestJSON-816552212 tempest-VolumesSnapshotsTestJSON-816552212-project] 10.222.0.81 "DELETE /compute/v2.1/os-snapshots/647c2b7b-265a-4fe7-a321-f3e116bf3140" status: 202 len: 0 microversion: 2.1 time: 0.348700 May 26 14:57:39.302213 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 16/31] 10.222.0.81 () {58 vars in 1254 bytes} [Wed May 26 14:57:38 2021] DELETE /compute/v2.1/os-snapshots/647c2b7b-265a-4fe7-a321-f3e116bf3140 => generated 0 bytes in 350 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 26 14:57:39.310283 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-cdf6e5d1-38ee-4d0f-af13-689f7da0ded0 tempest-VolumesSnapshotsTestJSON-816552212 tempest-VolumesSnapshotsTestJSON-816552212-project] Calling method '.version_select at 0x7f441f697ee0>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:57:39.437332 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-cdf6e5d1-38ee-4d0f-af13-689f7da0ded0 tempest-VolumesSnapshotsTestJSON-816552212 tempest-VolumesSnapshotsTestJSON-816552212-project] 10.222.0.81 "GET /compute/v2.1/os-snapshots/647c2b7b-265a-4fe7-a321-f3e116bf3140" status: 200 len: 286 microversion: 2.1 time: 0.121354 May 26 14:57:39.437332 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 17/32] 10.222.0.81 () {58 vars in 1251 bytes} [Wed May 26 14:57:39 2021] GET /compute/v2.1/os-snapshots/647c2b7b-265a-4fe7-a321-f3e116bf3140 => generated 286 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:57:39.957588 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-e3b4610b-d33c-4df8-88cd-5600d19192fb tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d6fb430257a489c8b8a1890ecb5ea93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f665681e524725b9abb121531f47a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:57:39.975784 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-e3b4610b-d33c-4df8-88cd-5600d19192fb tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] 10.222.0.81 "GET /compute/v2.1/servers/2b37b708-5d64-4e1f-9e17-32f528641ca5" status: 200 len: 1218 microversion: 2.1 time: 0.925493 May 26 14:57:39.989579 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 16/33] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:57:39 2021] GET /compute/v2.1/servers/2b37b708-5d64-4e1f-9e17-32f528641ca5 => generated 1218 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:57:40.438915 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-56ada76f-f0c0-42f2-b37d-b22045598851 tempest-VolumesSnapshotsTestJSON-816552212 tempest-VolumesSnapshotsTestJSON-816552212-project] Calling method '.version_select at 0x7f441f795d30>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:57:40.537097 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.wsgi [None req-56ada76f-f0c0-42f2-b37d-b22045598851 tempest-VolumesSnapshotsTestJSON-816552212 tempest-VolumesSnapshotsTestJSON-816552212-project] HTTP exception thrown: Snapshot 647c2b7b-265a-4fe7-a321-f3e116bf3140 could not be found. May 26 14:57:40.537958 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-56ada76f-f0c0-42f2-b37d-b22045598851 tempest-VolumesSnapshotsTestJSON-816552212 tempest-VolumesSnapshotsTestJSON-816552212-project] Returning 404 to user: Snapshot 647c2b7b-265a-4fe7-a321-f3e116bf3140 could not be found. {{(pid=118513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 26 14:57:40.538967 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-56ada76f-f0c0-42f2-b37d-b22045598851 tempest-VolumesSnapshotsTestJSON-816552212 tempest-VolumesSnapshotsTestJSON-816552212-project] 10.222.0.81 "GET /compute/v2.1/os-snapshots/647c2b7b-265a-4fe7-a321-f3e116bf3140" status: 404 len: 111 microversion: 2.1 time: 0.103738 May 26 14:57:40.539817 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 18/34] 10.222.0.81 () {58 vars in 1251 bytes} [Wed May 26 14:57:40 2021] GET /compute/v2.1/os-snapshots/647c2b7b-265a-4fe7-a321-f3e116bf3140 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 14:57:40.565443 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-ce76e560-f308-4086-9c39-da23d7699421 tempest-VolumesSnapshotsTestJSON-816552212 tempest-VolumesSnapshotsTestJSON-816552212-project] Calling method '.version_select at 0x7f441f66dca0>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:57:40.921893 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-ce76e560-f308-4086-9c39-da23d7699421 tempest-VolumesSnapshotsTestJSON-816552212 tempest-VolumesSnapshotsTestJSON-816552212-project] 10.222.0.81 "DELETE /compute/v2.1/os-volumes/5b9af6e1-7015-47a5-b75c-6a3542c33a14" status: 202 len: 0 microversion: 2.1 time: 0.358889 May 26 14:57:40.928184 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 17/35] 10.222.0.81 () {58 vars in 1248 bytes} [Wed May 26 14:57:40 2021] DELETE /compute/v2.1/os-volumes/5b9af6e1-7015-47a5-b75c-6a3542c33a14 => generated 0 bytes in 367 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 14:57:40.933919 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-e6803c4c-e147-4a7b-926a-541e99cfe12d tempest-VolumesSnapshotsTestJSON-816552212 tempest-VolumesSnapshotsTestJSON-816552212-project] Calling method '.version_select at 0x7f441f66b790>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:57:40.995911 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-0b969bb8-1e96-439e-9584-e79f20ee20e6 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:57:40.996959 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-0b969bb8-1e96-439e-9584-e79f20ee20e6 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] [instance: 2b37b708-5d64-4e1f-9e17-32f528641ca5] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:57:41.026559 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-0b969bb8-1e96-439e-9584-e79f20ee20e6 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:57:41.028441 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-0b969bb8-1e96-439e-9584-e79f20ee20e6 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:57:41.032921 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-0b969bb8-1e96-439e-9584-e79f20ee20e6 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:57:41.033480 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-0b969bb8-1e96-439e-9584-e79f20ee20e6 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:57:41.127633 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-e6803c4c-e147-4a7b-926a-541e99cfe12d tempest-VolumesSnapshotsTestJSON-816552212 tempest-VolumesSnapshotsTestJSON-816552212-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/5b9af6e1-7015-47a5-b75c-6a3542c33a14" status: 200 len: 343 microversion: 2.1 time: 0.198579 May 26 14:57:41.129244 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 19/36] 10.222.0.81 () {58 vars in 1245 bytes} [Wed May 26 14:57:40 2021] GET /compute/v2.1/os-volumes/5b9af6e1-7015-47a5-b75c-6a3542c33a14 => generated 343 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 14:57:41.476319 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-0b969bb8-1e96-439e-9584-e79f20ee20e6 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d6fb430257a489c8b8a1890ecb5ea93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f665681e524725b9abb121531f47a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:57:41.491377 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-0b969bb8-1e96-439e-9584-e79f20ee20e6 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] 10.222.0.81 "GET /compute/v2.1/servers/2b37b708-5d64-4e1f-9e17-32f528641ca5" status: 200 len: 1274 microversion: 2.1 time: 0.499207 May 26 14:57:41.493761 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 18/37] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:57:40 2021] GET /compute/v2.1/servers/2b37b708-5d64-4e1f-9e17-32f528641ca5 => generated 1274 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:57:42.146186 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-70b74a61-cf70-49b7-8761-0705c8ddf22d tempest-VolumesSnapshotsTestJSON-816552212 tempest-VolumesSnapshotsTestJSON-816552212-project] Calling method '.version_select at 0x7f441f697dc0>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:57:42.286837 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.wsgi [None req-70b74a61-cf70-49b7-8761-0705c8ddf22d tempest-VolumesSnapshotsTestJSON-816552212 tempest-VolumesSnapshotsTestJSON-816552212-project] HTTP exception thrown: Volume 5b9af6e1-7015-47a5-b75c-6a3542c33a14 could not be found. May 26 14:57:42.287453 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-70b74a61-cf70-49b7-8761-0705c8ddf22d tempest-VolumesSnapshotsTestJSON-816552212 tempest-VolumesSnapshotsTestJSON-816552212-project] Returning 404 to user: Volume 5b9af6e1-7015-47a5-b75c-6a3542c33a14 could not be found. {{(pid=118513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 26 14:57:42.288273 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-70b74a61-cf70-49b7-8761-0705c8ddf22d tempest-VolumesSnapshotsTestJSON-816552212 tempest-VolumesSnapshotsTestJSON-816552212-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/5b9af6e1-7015-47a5-b75c-6a3542c33a14" status: 404 len: 109 microversion: 2.1 time: 0.148397 May 26 14:57:42.288817 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 20/38] 10.222.0.81 () {58 vars in 1245 bytes} [Wed May 26 14:57:42 2021] GET /compute/v2.1/os-volumes/5b9af6e1-7015-47a5-b75c-6a3542c33a14 => generated 109 bytes in 150 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 26 14:57:42.303971 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-46788026-f52b-42c3-a409-b5b128fc61cb tempest-VolumesSnapshotsTestJSON-816552212 tempest-VolumesSnapshotsTestJSON-816552212-project] Calling method '.version_select at 0x7f441f6aa0d0>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:57:42.435697 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.wsgi [None req-46788026-f52b-42c3-a409-b5b128fc61cb tempest-VolumesSnapshotsTestJSON-816552212 tempest-VolumesSnapshotsTestJSON-816552212-project] HTTP exception thrown: Volume 5b9af6e1-7015-47a5-b75c-6a3542c33a14 could not be found. May 26 14:57:42.435697 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-46788026-f52b-42c3-a409-b5b128fc61cb tempest-VolumesSnapshotsTestJSON-816552212 tempest-VolumesSnapshotsTestJSON-816552212-project] Returning 404 to user: Volume 5b9af6e1-7015-47a5-b75c-6a3542c33a14 could not be found. {{(pid=118514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 26 14:57:42.435697 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-46788026-f52b-42c3-a409-b5b128fc61cb tempest-VolumesSnapshotsTestJSON-816552212 tempest-VolumesSnapshotsTestJSON-816552212-project] 10.222.0.81 "DELETE /compute/v2.1/os-volumes/5b9af6e1-7015-47a5-b75c-6a3542c33a14" status: 404 len: 109 microversion: 2.1 time: 0.135925 May 26 14:57:42.439103 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 19/39] 10.222.0.81 () {58 vars in 1248 bytes} [Wed May 26 14:57:42 2021] DELETE /compute/v2.1/os-volumes/5b9af6e1-7015-47a5-b75c-6a3542c33a14 => generated 109 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 14:57:42.445300 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-f9ef2c24-e432-4a0c-aadf-caca92f733e0 tempest-VolumesSnapshotsTestJSON-816552212 tempest-VolumesSnapshotsTestJSON-816552212-project] Calling method '.version_select at 0x7f441f7955e0>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:57:42.512129 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-6fb96321-bb9c-455f-98f5-1ba4b4da1ffa tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:57:42.512736 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-6fb96321-bb9c-455f-98f5-1ba4b4da1ffa tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] [instance: 2b37b708-5d64-4e1f-9e17-32f528641ca5] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:57:42.528683 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-6fb96321-bb9c-455f-98f5-1ba4b4da1ffa tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:57:42.530077 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-6fb96321-bb9c-455f-98f5-1ba4b4da1ffa tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:57:42.531051 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-6fb96321-bb9c-455f-98f5-1ba4b4da1ffa tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:57:42.531655 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-6fb96321-bb9c-455f-98f5-1ba4b4da1ffa tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:57:42.589197 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.wsgi [None req-f9ef2c24-e432-4a0c-aadf-caca92f733e0 tempest-VolumesSnapshotsTestJSON-816552212 tempest-VolumesSnapshotsTestJSON-816552212-project] HTTP exception thrown: Volume 5b9af6e1-7015-47a5-b75c-6a3542c33a14 could not be found. May 26 14:57:42.590032 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-f9ef2c24-e432-4a0c-aadf-caca92f733e0 tempest-VolumesSnapshotsTestJSON-816552212 tempest-VolumesSnapshotsTestJSON-816552212-project] Returning 404 to user: Volume 5b9af6e1-7015-47a5-b75c-6a3542c33a14 could not be found. {{(pid=118513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 26 14:57:42.591215 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-f9ef2c24-e432-4a0c-aadf-caca92f733e0 tempest-VolumesSnapshotsTestJSON-816552212 tempest-VolumesSnapshotsTestJSON-816552212-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/5b9af6e1-7015-47a5-b75c-6a3542c33a14" status: 404 len: 109 microversion: 2.1 time: 0.151320 May 26 14:57:42.592244 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 21/40] 10.222.0.81 () {58 vars in 1245 bytes} [Wed May 26 14:57:42 2021] GET /compute/v2.1/os-volumes/5b9af6e1-7015-47a5-b75c-6a3542c33a14 => generated 109 bytes in 153 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 14:57:42.989580 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-6fb96321-bb9c-455f-98f5-1ba4b4da1ffa tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d6fb430257a489c8b8a1890ecb5ea93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f665681e524725b9abb121531f47a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:57:43.008806 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-6fb96321-bb9c-455f-98f5-1ba4b4da1ffa tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] 10.222.0.81 "GET /compute/v2.1/servers/2b37b708-5d64-4e1f-9e17-32f528641ca5" status: 200 len: 1272 microversion: 2.1 time: 0.496484 May 26 14:57:43.009737 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 20/41] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:57:42 2021] GET /compute/v2.1/servers/2b37b708-5d64-4e1f-9e17-32f528641ca5 => generated 1272 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 14:57:44.038071 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-1c232bfe-6179-4ec3-8dca-c337e0cfa3df tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:57:44.039426 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-1c232bfe-6179-4ec3-8dca-c337e0cfa3df tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] [instance: 2b37b708-5d64-4e1f-9e17-32f528641ca5] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:57:44.063253 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-1c232bfe-6179-4ec3-8dca-c337e0cfa3df tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:57:44.064210 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-1c232bfe-6179-4ec3-8dca-c337e0cfa3df tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:57:44.065250 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-1c232bfe-6179-4ec3-8dca-c337e0cfa3df tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:57:44.066638 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-1c232bfe-6179-4ec3-8dca-c337e0cfa3df tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:57:45.113923 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-1c232bfe-6179-4ec3-8dca-c337e0cfa3df tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d6fb430257a489c8b8a1890ecb5ea93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f665681e524725b9abb121531f47a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:57:45.141647 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-1c232bfe-6179-4ec3-8dca-c337e0cfa3df tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] 10.222.0.81 "GET /compute/v2.1/servers/2b37b708-5d64-4e1f-9e17-32f528641ca5" status: 200 len: 1272 microversion: 2.1 time: 1.112598 May 26 14:57:45.151978 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 22/42] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:57:44 2021] GET /compute/v2.1/servers/2b37b708-5d64-4e1f-9e17-32f528641ca5 => generated 1272 bytes in 1122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:57:46.161573 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-0151b4d0-0103-40e1-8f37-b0f6018a1a80 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:57:46.162251 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-0151b4d0-0103-40e1-8f37-b0f6018a1a80 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] [instance: 2b37b708-5d64-4e1f-9e17-32f528641ca5] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:57:46.203931 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-0151b4d0-0103-40e1-8f37-b0f6018a1a80 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:57:46.204396 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-0151b4d0-0103-40e1-8f37-b0f6018a1a80 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:57:46.213892 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-0151b4d0-0103-40e1-8f37-b0f6018a1a80 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:57:46.214741 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-0151b4d0-0103-40e1-8f37-b0f6018a1a80 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:57:48.017684 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-74bd9f4e-3052-458d-90ff-f4877b479341 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Action: 'create', calling method: .version_select at 0x7f441f683b80>, body: {"keypair": {"name": "tempest-keypair-1526408858"}} {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:57:48.103594 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.quota [None req-74bd9f4e-3052-458d-90ff-f4877b479341 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Getting quotas for project 81e8cac36a174b2eb5a6e53fdf25b4cc. Resources: {'key_pairs'} {{(pid=118513) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 26 14:57:48.118233 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.quota [None req-74bd9f4e-3052-458d-90ff-f4877b479341 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Getting quotas for user 8c2fb208b56d4d52b59ac09873f16180 and project 81e8cac36a174b2eb5a6e53fdf25b4cc. Resources: {'key_pairs'} {{(pid=118513) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 26 14:57:48.637710 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.quota [None req-74bd9f4e-3052-458d-90ff-f4877b479341 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Getting quotas for project 81e8cac36a174b2eb5a6e53fdf25b4cc. Resources: {'key_pairs'} {{(pid=118513) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 26 14:57:48.656210 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.quota [None req-74bd9f4e-3052-458d-90ff-f4877b479341 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Getting quotas for user 8c2fb208b56d4d52b59ac09873f16180 and project 81e8cac36a174b2eb5a6e53fdf25b4cc. Resources: {'key_pairs'} {{(pid=118513) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 26 14:57:48.718460 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-74bd9f4e-3052-458d-90ff-f4877b479341 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 1.164960 May 26 14:57:48.719750 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 23/43] 10.222.0.81 () {60 vars in 1158 bytes} [Wed May 26 14:57:47 2021] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 1167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:57:50.266319 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-0151b4d0-0103-40e1-8f37-b0f6018a1a80 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d6fb430257a489c8b8a1890ecb5ea93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f665681e524725b9abb121531f47a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:57:50.283718 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-0151b4d0-0103-40e1-8f37-b0f6018a1a80 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] 10.222.0.81 "GET /compute/v2.1/servers/2b37b708-5d64-4e1f-9e17-32f528641ca5" status: 200 len: 1314 microversion: 2.1 time: 4.127901 May 26 14:57:50.287617 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 21/44] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:57:46 2021] GET /compute/v2.1/servers/2b37b708-5d64-4e1f-9e17-32f528641ca5 => generated 1314 bytes in 4133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:57:51.304879 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-e07d726c-d2dd-4d46-a061-64fcfd28a625 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:57:51.305573 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-e07d726c-d2dd-4d46-a061-64fcfd28a625 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] [instance: 2b37b708-5d64-4e1f-9e17-32f528641ca5] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:57:51.336438 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-e07d726c-d2dd-4d46-a061-64fcfd28a625 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:57:51.340869 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-e07d726c-d2dd-4d46-a061-64fcfd28a625 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:57:51.342340 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-e07d726c-d2dd-4d46-a061-64fcfd28a625 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:57:51.345747 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-e07d726c-d2dd-4d46-a061-64fcfd28a625 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:57:51.391161 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [req-92d4176c-6eb3-483d-bd3d-3d8e3a0298a3 req-ebef94e8-2ced-4a1a-849b-d9ee62829829 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b37b708-5d64-4e1f-9e17-32f528641ca5", "tag": "24b593cd-0651-4f0f-aa78-c431b4dbb3f1"}]} {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:57:51.393998 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 14:57:51.393998 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: warnings.warn(msg) May 26 14:57:51.405390 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [req-92d4176c-6eb3-483d-bd3d-3d8e3a0298a3 req-ebef94e8-2ced-4a1a-849b-d9ee62829829 service nova] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:57:51.406089 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [req-92d4176c-6eb3-483d-bd3d-3d8e3a0298a3 req-ebef94e8-2ced-4a1a-849b-d9ee62829829 service nova] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:57:51.429100 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.compute.server_external_events [req-92d4176c-6eb3-483d-bd3d-3d8e3a0298a3 req-ebef94e8-2ced-4a1a-849b-d9ee62829829 service nova] Creating event network-changed:24b593cd-0651-4f0f-aa78-c431b4dbb3f1 for instance 2b37b708-5d64-4e1f-9e17-32f528641ca5 on hv-cinder-78414 May 26 14:57:51.429885 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [req-92d4176c-6eb3-483d-bd3d-3d8e3a0298a3 req-ebef94e8-2ced-4a1a-849b-d9ee62829829 service nova] Acquired lock "compute-rpcapi-router" {{(pid=118513) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} May 26 14:57:51.431396 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-aad9cfa5-d125-4f7c-9c67-47d8bb50b3d7 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:57:51.432305 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-aad9cfa5-d125-4f7c-9c67-47d8bb50b3d7 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:57:51.433295 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-aad9cfa5-d125-4f7c-9c67-47d8bb50b3d7 None None] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:57:51.433958 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-aad9cfa5-d125-4f7c-9c67-47d8bb50b3d7 None None] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:57:51.450591 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.compute.rpcapi [None req-aad9cfa5-d125-4f7c-9c67-47d8bb50b3d7 None None] Automatically selected compute RPC version 6.0 from minimum service version 56 May 26 14:57:51.457688 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-aad9cfa5-d125-4f7c-9c67-47d8bb50b3d7 None None] Releasing lock "compute-rpcapi-router" {{(pid=118513) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} May 26 14:57:51.523961 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-aad9cfa5-d125-4f7c-9c67-47d8bb50b3d7 None None] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.291631 May 26 14:57:51.524774 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 24/45] 10.222.0.81 () {64 vars in 1318 bytes} [Wed May 26 14:57:51 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:57:52.009171 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-e07d726c-d2dd-4d46-a061-64fcfd28a625 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d6fb430257a489c8b8a1890ecb5ea93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f665681e524725b9abb121531f47a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:57:52.017327 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-e07d726c-d2dd-4d46-a061-64fcfd28a625 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] 10.222.0.81 "GET /compute/v2.1/servers/2b37b708-5d64-4e1f-9e17-32f528641ca5" status: 200 len: 1314 microversion: 2.1 time: 0.717091 May 26 14:57:52.027450 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 22/46] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:57:51 2021] GET /compute/v2.1/servers/2b37b708-5d64-4e1f-9e17-32f528641ca5 => generated 1314 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 14:57:53.039112 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-56f6dd67-3ffc-4545-82e1-8cb0a78dc87b tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:57:53.039844 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-56f6dd67-3ffc-4545-82e1-8cb0a78dc87b tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] [instance: 2b37b708-5d64-4e1f-9e17-32f528641ca5] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:57:53.091511 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-56f6dd67-3ffc-4545-82e1-8cb0a78dc87b tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:57:53.091980 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-56f6dd67-3ffc-4545-82e1-8cb0a78dc87b tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:57:53.112002 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-56f6dd67-3ffc-4545-82e1-8cb0a78dc87b tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:57:53.117534 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-56f6dd67-3ffc-4545-82e1-8cb0a78dc87b tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:57:53.976464 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-56f6dd67-3ffc-4545-82e1-8cb0a78dc87b tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d6fb430257a489c8b8a1890ecb5ea93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f665681e524725b9abb121531f47a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:57:53.990828 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-56f6dd67-3ffc-4545-82e1-8cb0a78dc87b tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] 10.222.0.81 "GET /compute/v2.1/servers/2b37b708-5d64-4e1f-9e17-32f528641ca5" status: 200 len: 1314 microversion: 2.1 time: 0.959273 May 26 14:57:53.992063 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 25/47] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:57:53 2021] GET /compute/v2.1/servers/2b37b708-5d64-4e1f-9e17-32f528641ca5 => generated 1314 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:57:55.052931 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-ac5d7e54-c7b9-4891-a564-49296e5dacd7 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1371767399", "imageRef": "dcacad62-e278-4869-aa20-e5df07dd03db", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bc70d705-69d9-4bd7-ad11-798aa6a60676"}]}} {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:57:55.054150 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-c82128eb-a585-4f67-9715-b7826dd6aadf tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:57:55.054150 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-c82128eb-a585-4f67-9715-b7826dd6aadf tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] [instance: 2b37b708-5d64-4e1f-9e17-32f528641ca5] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:57:55.054150 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-c82128eb-a585-4f67-9715-b7826dd6aadf tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:57:55.054150 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-c82128eb-a585-4f67-9715-b7826dd6aadf tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:57:55.055155 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-c82128eb-a585-4f67-9715-b7826dd6aadf tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:57:55.055155 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-c82128eb-a585-4f67-9715-b7826dd6aadf tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:57:55.279885 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.network.neutron [None req-ac5d7e54-c7b9-4891-a564-49296e5dacd7 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] validate_networks() for [('bc70d705-69d9-4bd7-ad11-798aa6a60676', None, None, None)] {{(pid=118514) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} May 26 14:57:56.070394 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-c82128eb-a585-4f67-9715-b7826dd6aadf tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d6fb430257a489c8b8a1890ecb5ea93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f665681e524725b9abb121531f47a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:57:56.079507 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-c82128eb-a585-4f67-9715-b7826dd6aadf tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] 10.222.0.81 "GET /compute/v2.1/servers/2b37b708-5d64-4e1f-9e17-32f528641ca5" status: 200 len: 1314 microversion: 2.1 time: 1.073891 May 26 14:57:56.110909 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 26/48] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:57:55 2021] GET /compute/v2.1/servers/2b37b708-5d64-4e1f-9e17-32f528641ca5 => generated 1314 bytes in 1105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:57:57.320898 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-92007794-9847-404e-a647-68eb225a0a12 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Action: 'create', calling method: .version_select at 0x7f441edb7430>, body: {"keypair": {"name": "tempest-keypair-67106449"}} {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:57:57.391510 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.quota [None req-92007794-9847-404e-a647-68eb225a0a12 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Getting quotas for project 7555f6895a2a405685d8ccfe81fe5a74. Resources: {'key_pairs'} {{(pid=118513) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 26 14:57:57.404733 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.quota [None req-92007794-9847-404e-a647-68eb225a0a12 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Getting quotas for user de739c6952a94c308a9cc89c738d8500 and project 7555f6895a2a405685d8ccfe81fe5a74. Resources: {'key_pairs'} {{(pid=118513) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 26 14:57:57.923257 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.quota [None req-92007794-9847-404e-a647-68eb225a0a12 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Getting quotas for project 7555f6895a2a405685d8ccfe81fe5a74. Resources: {'key_pairs'} {{(pid=118513) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 26 14:57:57.931866 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.quota [None req-92007794-9847-404e-a647-68eb225a0a12 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Getting quotas for user de739c6952a94c308a9cc89c738d8500 and project 7555f6895a2a405685d8ccfe81fe5a74. Resources: {'key_pairs'} {{(pid=118513) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 26 14:57:57.962393 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-92007794-9847-404e-a647-68eb225a0a12 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 201 len: 2314 microversion: 2.20 time: 1.571006 May 26 14:57:57.989167 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 27/49] 10.222.0.81 () {62 vars in 1199 bytes} [Wed May 26 14:57:56 2021] POST /compute/v2.1/os-keypairs => generated 2314 bytes in 1599 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) May 26 14:57:58.002524 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-db86aa9e-7286-4470-90df-9a25f76b8bf2 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1711966727", "imageRef": "dcacad62-e278-4869-aa20-e5df07dd03db", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9a6b2b45-d448-425b-9716-75ffabad6539"}], "security_groups": [{"name": "tempest-securitygroup--1735163795"}], "key_name": "tempest-keypair-1526408858", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:57:58.792383 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.network.neutron [None req-db86aa9e-7286-4470-90df-9a25f76b8bf2 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] validate_networks() for [('9a6b2b45-d448-425b-9716-75ffabad6539', None, None, None)] {{(pid=118513) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} May 26 14:57:59.316286 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.virt.hardware [None req-ac5d7e54-c7b9-4891-a564-49296e5dacd7 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Flavor limits 0:0:0 {{(pid=118514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} May 26 14:57:59.317037 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.virt.hardware [None req-ac5d7e54-c7b9-4891-a564-49296e5dacd7 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Image limits 0:0:0 {{(pid=118514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} May 26 14:57:59.317971 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.virt.hardware [None req-ac5d7e54-c7b9-4891-a564-49296e5dacd7 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Flavor pref 0:0:0 {{(pid=118514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} May 26 14:57:59.319234 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.virt.hardware [None req-ac5d7e54-c7b9-4891-a564-49296e5dacd7 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Image pref 0:0:0 {{(pid=118514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} May 26 14:57:59.320295 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.virt.hardware [None req-ac5d7e54-c7b9-4891-a564-49296e5dacd7 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} May 26 14:57:59.345089 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-ac5d7e54-c7b9-4891-a564-49296e5dacd7 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:57:59.350420 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-ac5d7e54-c7b9-4891-a564-49296e5dacd7 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:57:59.350420 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-ac5d7e54-c7b9-4891-a564-49296e5dacd7 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:57:59.350420 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-ac5d7e54-c7b9-4891-a564-49296e5dacd7 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:57:59.405766 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.quota [None req-ac5d7e54-c7b9-4891-a564-49296e5dacd7 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Getting quotas for project 0ad2ab2705ca479ab4aaafe7c80de162. Resources: {'instances', 'ram', 'cores'} {{(pid=118514) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 26 14:57:59.413501 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.quota [None req-ac5d7e54-c7b9-4891-a564-49296e5dacd7 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Getting quotas for user b167942c895345b186a3eda5c82175b8 and project 0ad2ab2705ca479ab4aaafe7c80de162. Resources: {'instances', 'ram', 'cores'} {{(pid=118514) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 26 14:57:59.432283 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-ac5d7e54-c7b9-4891-a564-49296e5dacd7 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Going to run 1 instances... {{(pid=118514) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 26 14:57:59.432283 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-ac5d7e54-c7b9-4891-a564-49296e5dacd7 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] [instance: aa145a33-41b1-4e39-9642-132aca11fcfe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dcacad62-e278-4869-aa20-e5df07dd03db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118514) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} May 26 14:57:59.776673 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-ac5d7e54-c7b9-4891-a564-49296e5dacd7 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 5.704012 May 26 14:57:59.783344 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 23/50] 10.222.0.81 () {60 vars in 1147 bytes} [Wed May 26 14:57:54 2021] POST /compute/v2.1/servers => generated 383 bytes in 5713 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 14:57:59.789745 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-3de53794-a254-47ce-8122-b8142aa706dd tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:57:59.793567 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-3de53794-a254-47ce-8122-b8142aa706dd tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] [instance: 2b37b708-5d64-4e1f-9e17-32f528641ca5] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:57:59.812135 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-3de53794-a254-47ce-8122-b8142aa706dd tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:57:59.812843 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-3de53794-a254-47ce-8122-b8142aa706dd tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:57:59.813914 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-3de53794-a254-47ce-8122-b8142aa706dd tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:57:59.814373 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-3de53794-a254-47ce-8122-b8142aa706dd tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:00.760337 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-3de53794-a254-47ce-8122-b8142aa706dd tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d6fb430257a489c8b8a1890ecb5ea93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f665681e524725b9abb121531f47a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:58:00.774883 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-3de53794-a254-47ce-8122-b8142aa706dd tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] 10.222.0.81 "GET /compute/v2.1/servers/2b37b708-5d64-4e1f-9e17-32f528641ca5" status: 200 len: 1314 microversion: 2.1 time: 0.985850 May 26 14:58:00.774883 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 24/51] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:57:59 2021] GET /compute/v2.1/servers/2b37b708-5d64-4e1f-9e17-32f528641ca5 => generated 1314 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:58:00.794175 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-eb8d8cfc-93ce-4f72-9b9c-6992aaba2522 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:58:00.794920 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-eb8d8cfc-93ce-4f72-9b9c-6992aaba2522 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] [instance: aa145a33-41b1-4e39-9642-132aca11fcfe] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:58:01.011312 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-eb8d8cfc-93ce-4f72-9b9c-6992aaba2522 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b167942c895345b186a3eda5c82175b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad2ab2705ca479ab4aaafe7c80de162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:58:01.024951 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-eb8d8cfc-93ce-4f72-9b9c-6992aaba2522 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /compute/v2.1/servers/aa145a33-41b1-4e39-9642-132aca11fcfe" status: 200 len: 1222 microversion: 2.1 time: 0.251678 May 26 14:58:01.025898 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 25/52] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:58:00 2021] GET /compute/v2.1/servers/aa145a33-41b1-4e39-9642-132aca11fcfe => generated 1222 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:58:01.276953 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-e5f0e8ec-7d22-4f0f-b139-901e560ce86f tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1597347424", "imageRef": "dcacad62-e278-4869-aa20-e5df07dd03db", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bc70d705-69d9-4bd7-ad11-798aa6a60676"}]}} {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:58:01.457275 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.network.neutron [None req-e5f0e8ec-7d22-4f0f-b139-901e560ce86f tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] validate_networks() for [('bc70d705-69d9-4bd7-ad11-798aa6a60676', None, None, None)] {{(pid=118514) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} May 26 14:58:01.935546 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.virt.hardware [None req-db86aa9e-7286-4470-90df-9a25f76b8bf2 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Flavor limits 0:0:0 {{(pid=118513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} May 26 14:58:01.936683 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.virt.hardware [None req-db86aa9e-7286-4470-90df-9a25f76b8bf2 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Image limits 0:0:0 {{(pid=118513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} May 26 14:58:01.937122 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.virt.hardware [None req-db86aa9e-7286-4470-90df-9a25f76b8bf2 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Flavor pref 0:0:0 {{(pid=118513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} May 26 14:58:01.937572 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.virt.hardware [None req-db86aa9e-7286-4470-90df-9a25f76b8bf2 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Image pref 0:0:0 {{(pid=118513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} May 26 14:58:01.938004 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.virt.hardware [None req-db86aa9e-7286-4470-90df-9a25f76b8bf2 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} May 26 14:58:01.960924 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-db86aa9e-7286-4470-90df-9a25f76b8bf2 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:01.960924 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-db86aa9e-7286-4470-90df-9a25f76b8bf2 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:01.960924 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-db86aa9e-7286-4470-90df-9a25f76b8bf2 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:01.960924 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-db86aa9e-7286-4470-90df-9a25f76b8bf2 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:01.996523 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.quota [None req-db86aa9e-7286-4470-90df-9a25f76b8bf2 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Getting quotas for project 81e8cac36a174b2eb5a6e53fdf25b4cc. Resources: {'instances', 'ram', 'cores'} {{(pid=118513) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 26 14:58:02.002137 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.quota [None req-db86aa9e-7286-4470-90df-9a25f76b8bf2 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Getting quotas for user 8c2fb208b56d4d52b59ac09873f16180 and project 81e8cac36a174b2eb5a6e53fdf25b4cc. Resources: {'instances', 'ram', 'cores'} {{(pid=118513) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 26 14:58:02.015703 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-db86aa9e-7286-4470-90df-9a25f76b8bf2 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Going to run 1 instances... {{(pid=118513) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 26 14:58:02.018887 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-db86aa9e-7286-4470-90df-9a25f76b8bf2 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: a9d8f9a6-bd66-4caa-8662-4bb94655ae59] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dcacad62-e278-4869-aa20-e5df07dd03db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118513) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} May 26 14:58:02.207209 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-db86aa9e-7286-4470-90df-9a25f76b8bf2 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 4.216298 May 26 14:58:02.221025 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 28/53] 10.222.0.81 () {60 vars in 1147 bytes} [Wed May 26 14:57:57 2021] POST /compute/v2.1/servers => generated 402 bytes in 4231 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 14:58:02.243580 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-43644d01-a453-432a-a324-c93bff8ac6d5 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:58:02.251970 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-43644d01-a453-432a-a324-c93bff8ac6d5 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] [instance: 2b37b708-5d64-4e1f-9e17-32f528641ca5] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:58:02.275585 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-43644d01-a453-432a-a324-c93bff8ac6d5 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:02.276045 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-43644d01-a453-432a-a324-c93bff8ac6d5 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:02.276852 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-43644d01-a453-432a-a324-c93bff8ac6d5 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:02.277300 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-43644d01-a453-432a-a324-c93bff8ac6d5 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:02.736571 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-43644d01-a453-432a-a324-c93bff8ac6d5 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d6fb430257a489c8b8a1890ecb5ea93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f665681e524725b9abb121531f47a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:58:02.745487 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-43644d01-a453-432a-a324-c93bff8ac6d5 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] 10.222.0.81 "GET /compute/v2.1/servers/2b37b708-5d64-4e1f-9e17-32f528641ca5" status: 200 len: 1314 microversion: 2.1 time: 0.522530 May 26 14:58:02.749762 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 29/54] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:58:02 2021] GET /compute/v2.1/servers/2b37b708-5d64-4e1f-9e17-32f528641ca5 => generated 1314 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:58:02.757210 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-77de3de9-355e-4267-86e4-b1fdebda31f8 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:58:02.758962 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-77de3de9-355e-4267-86e4-b1fdebda31f8 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: a9d8f9a6-bd66-4caa-8662-4bb94655ae59] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:58:03.089216 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-77de3de9-355e-4267-86e4-b1fdebda31f8 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c2fb208b56d4d52b59ac09873f16180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e8cac36a174b2eb5a6e53fdf25b4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:58:03.102127 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-77de3de9-355e-4267-86e4-b1fdebda31f8 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59" status: 200 len: 1238 microversion: 2.1 time: 0.345767 May 26 14:58:03.103708 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 30/55] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:58:02 2021] GET /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59 => generated 1238 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:58:03.319849 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.virt.hardware [None req-e5f0e8ec-7d22-4f0f-b139-901e560ce86f tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Flavor limits 0:0:0 {{(pid=118514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} May 26 14:58:03.320343 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.virt.hardware [None req-e5f0e8ec-7d22-4f0f-b139-901e560ce86f tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Image limits 0:0:0 {{(pid=118514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} May 26 14:58:03.324089 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.virt.hardware [None req-e5f0e8ec-7d22-4f0f-b139-901e560ce86f tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Flavor pref 0:0:0 {{(pid=118514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} May 26 14:58:03.324089 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.virt.hardware [None req-e5f0e8ec-7d22-4f0f-b139-901e560ce86f tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Image pref 0:0:0 {{(pid=118514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} May 26 14:58:03.325226 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.virt.hardware [None req-e5f0e8ec-7d22-4f0f-b139-901e560ce86f tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} May 26 14:58:03.349057 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-e5f0e8ec-7d22-4f0f-b139-901e560ce86f tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:03.350420 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-e5f0e8ec-7d22-4f0f-b139-901e560ce86f tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:03.353358 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-e5f0e8ec-7d22-4f0f-b139-901e560ce86f tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:03.353998 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-e5f0e8ec-7d22-4f0f-b139-901e560ce86f tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:03.408220 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.quota [None req-e5f0e8ec-7d22-4f0f-b139-901e560ce86f tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Getting quotas for project 0ad2ab2705ca479ab4aaafe7c80de162. Resources: {'instances', 'ram', 'cores'} {{(pid=118514) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 26 14:58:03.423882 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.quota [None req-e5f0e8ec-7d22-4f0f-b139-901e560ce86f tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Getting quotas for user b167942c895345b186a3eda5c82175b8 and project 0ad2ab2705ca479ab4aaafe7c80de162. Resources: {'instances', 'ram', 'cores'} {{(pid=118514) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 26 14:58:03.461198 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-e5f0e8ec-7d22-4f0f-b139-901e560ce86f tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Going to run 1 instances... {{(pid=118514) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 26 14:58:03.467100 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-e5f0e8ec-7d22-4f0f-b139-901e560ce86f tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] [instance: acc03344-b5df-4277-82e4-c9b3228969ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dcacad62-e278-4869-aa20-e5df07dd03db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118514) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} May 26 14:58:03.644141 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-e5f0e8ec-7d22-4f0f-b139-901e560ce86f tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.371815 May 26 14:58:03.645487 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 26/56] 10.222.0.81 () {60 vars in 1147 bytes} [Wed May 26 14:58:01 2021] POST /compute/v2.1/servers => generated 383 bytes in 2374 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 14:58:03.656584 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-ef6bfcf8-e91e-494b-8b2d-a5d1269e0a95 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:58:03.657715 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-ef6bfcf8-e91e-494b-8b2d-a5d1269e0a95 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] [instance: acc03344-b5df-4277-82e4-c9b3228969ca] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:58:03.769274 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-9d224b8b-8f1c-489d-83b8-b4fb83f247e1 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:58:03.770153 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-9d224b8b-8f1c-489d-83b8-b4fb83f247e1 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] [instance: 2b37b708-5d64-4e1f-9e17-32f528641ca5] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:58:03.788644 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-9d224b8b-8f1c-489d-83b8-b4fb83f247e1 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:03.789773 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-9d224b8b-8f1c-489d-83b8-b4fb83f247e1 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:03.791269 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-9d224b8b-8f1c-489d-83b8-b4fb83f247e1 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:03.791871 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-9d224b8b-8f1c-489d-83b8-b4fb83f247e1 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:03.928156 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-ef6bfcf8-e91e-494b-8b2d-a5d1269e0a95 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b167942c895345b186a3eda5c82175b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad2ab2705ca479ab4aaafe7c80de162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:58:03.950172 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-ef6bfcf8-e91e-494b-8b2d-a5d1269e0a95 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /compute/v2.1/servers/acc03344-b5df-4277-82e4-c9b3228969ca" status: 200 len: 1222 microversion: 2.1 time: 0.297763 May 26 14:58:03.954450 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 31/57] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:58:03 2021] GET /compute/v2.1/servers/acc03344-b5df-4277-82e4-c9b3228969ca => generated 1222 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:58:04.125892 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-059cc902-010f-4330-9a94-f837b3efcf80 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:58:04.126487 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-059cc902-010f-4330-9a94-f837b3efcf80 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: a9d8f9a6-bd66-4caa-8662-4bb94655ae59] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:58:04.137862 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-059cc902-010f-4330-9a94-f837b3efcf80 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:04.138317 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-059cc902-010f-4330-9a94-f837b3efcf80 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:04.140809 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-059cc902-010f-4330-9a94-f837b3efcf80 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:04.142734 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-059cc902-010f-4330-9a94-f837b3efcf80 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:04.582670 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-059cc902-010f-4330-9a94-f837b3efcf80 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c2fb208b56d4d52b59ac09873f16180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e8cac36a174b2eb5a6e53fdf25b4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:58:04.593573 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-059cc902-010f-4330-9a94-f837b3efcf80 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59" status: 200 len: 1242 microversion: 2.1 time: 0.471158 May 26 14:58:04.594252 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 32/58] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:58:04 2021] GET /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59 => generated 1242 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 14:58:04.763544 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-9d224b8b-8f1c-489d-83b8-b4fb83f247e1 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d6fb430257a489c8b8a1890ecb5ea93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f665681e524725b9abb121531f47a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:58:04.763544 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-9d224b8b-8f1c-489d-83b8-b4fb83f247e1 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] 10.222.0.81 "GET /compute/v2.1/servers/2b37b708-5d64-4e1f-9e17-32f528641ca5" status: 200 len: 1314 microversion: 2.1 time: 0.996074 May 26 14:58:04.763544 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 27/59] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:58:03 2021] GET /compute/v2.1/servers/2b37b708-5d64-4e1f-9e17-32f528641ca5 => generated 1314 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:58:04.973837 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-77b263ca-c4a0-4a5a-a4fd-c7e3c13e1b07 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:58:04.975144 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-77b263ca-c4a0-4a5a-a4fd-c7e3c13e1b07 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] [instance: acc03344-b5df-4277-82e4-c9b3228969ca] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:58:04.987553 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-77b263ca-c4a0-4a5a-a4fd-c7e3c13e1b07 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:04.988476 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-77b263ca-c4a0-4a5a-a4fd-c7e3c13e1b07 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:04.989524 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-77b263ca-c4a0-4a5a-a4fd-c7e3c13e1b07 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:04.990180 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-77b263ca-c4a0-4a5a-a4fd-c7e3c13e1b07 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:05.278922 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-77b263ca-c4a0-4a5a-a4fd-c7e3c13e1b07 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b167942c895345b186a3eda5c82175b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad2ab2705ca479ab4aaafe7c80de162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:58:05.297923 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-77b263ca-c4a0-4a5a-a4fd-c7e3c13e1b07 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /compute/v2.1/servers/acc03344-b5df-4277-82e4-c9b3228969ca" status: 200 len: 1226 microversion: 2.1 time: 0.331164 May 26 14:58:05.298510 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 33/60] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:58:04 2021] GET /compute/v2.1/servers/acc03344-b5df-4277-82e4-c9b3228969ca => generated 1226 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:58:05.610528 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-2ddad5b6-b32d-407a-bcfa-5ca2753d0a20 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:58:05.611148 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-2ddad5b6-b32d-407a-bcfa-5ca2753d0a20 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: a9d8f9a6-bd66-4caa-8662-4bb94655ae59] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:58:05.624740 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-2ddad5b6-b32d-407a-bcfa-5ca2753d0a20 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:05.624740 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-2ddad5b6-b32d-407a-bcfa-5ca2753d0a20 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:05.625183 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-2ddad5b6-b32d-407a-bcfa-5ca2753d0a20 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:05.626017 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-2ddad5b6-b32d-407a-bcfa-5ca2753d0a20 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:05.778429 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-0ec7b3f7-b219-4286-a6eb-d906b762dff6 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:58:05.779157 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-0ec7b3f7-b219-4286-a6eb-d906b762dff6 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] [instance: 2b37b708-5d64-4e1f-9e17-32f528641ca5] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:58:05.787315 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-0ec7b3f7-b219-4286-a6eb-d906b762dff6 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:05.787786 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-0ec7b3f7-b219-4286-a6eb-d906b762dff6 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:05.788750 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-0ec7b3f7-b219-4286-a6eb-d906b762dff6 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:05.789342 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-0ec7b3f7-b219-4286-a6eb-d906b762dff6 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:05.836899 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-2ddad5b6-b32d-407a-bcfa-5ca2753d0a20 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c2fb208b56d4d52b59ac09873f16180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e8cac36a174b2eb5a6e53fdf25b4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:58:05.846246 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-2ddad5b6-b32d-407a-bcfa-5ca2753d0a20 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59" status: 200 len: 1298 microversion: 2.1 time: 0.239251 May 26 14:58:05.854214 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 28/61] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:58:05 2021] GET /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59 => generated 1298 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:58:06.316149 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-1fca8edc-a5bb-44ea-afe8-422771877bce tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:58:06.316842 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-1fca8edc-a5bb-44ea-afe8-422771877bce tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] [instance: acc03344-b5df-4277-82e4-c9b3228969ca] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:58:06.333025 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-1fca8edc-a5bb-44ea-afe8-422771877bce tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:06.333759 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-1fca8edc-a5bb-44ea-afe8-422771877bce tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:06.335039 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-1fca8edc-a5bb-44ea-afe8-422771877bce tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:06.335634 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-1fca8edc-a5bb-44ea-afe8-422771877bce tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:06.507768 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-1fca8edc-a5bb-44ea-afe8-422771877bce tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b167942c895345b186a3eda5c82175b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad2ab2705ca479ab4aaafe7c80de162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:58:06.524977 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-1fca8edc-a5bb-44ea-afe8-422771877bce tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /compute/v2.1/servers/acc03344-b5df-4277-82e4-c9b3228969ca" status: 200 len: 1274 microversion: 2.1 time: 0.213647 May 26 14:58:06.526189 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 29/62] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:58:06 2021] GET /compute/v2.1/servers/acc03344-b5df-4277-82e4-c9b3228969ca => generated 1274 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:58:06.645888 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-0ec7b3f7-b219-4286-a6eb-d906b762dff6 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d6fb430257a489c8b8a1890ecb5ea93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f665681e524725b9abb121531f47a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:58:06.657476 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-0ec7b3f7-b219-4286-a6eb-d906b762dff6 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] 10.222.0.81 "GET /compute/v2.1/servers/2b37b708-5d64-4e1f-9e17-32f528641ca5" status: 200 len: 1314 microversion: 2.1 time: 0.882715 May 26 14:58:06.658491 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 34/63] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:58:05 2021] GET /compute/v2.1/servers/2b37b708-5d64-4e1f-9e17-32f528641ca5 => generated 1314 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 14:58:06.864830 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-06e1fb27-93f5-4ec4-be5a-5918423fce7c tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:58:06.865616 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-06e1fb27-93f5-4ec4-be5a-5918423fce7c tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: a9d8f9a6-bd66-4caa-8662-4bb94655ae59] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:58:06.885180 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-06e1fb27-93f5-4ec4-be5a-5918423fce7c tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:06.885829 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-06e1fb27-93f5-4ec4-be5a-5918423fce7c tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:06.887911 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-06e1fb27-93f5-4ec4-be5a-5918423fce7c tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:06.889490 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-06e1fb27-93f5-4ec4-be5a-5918423fce7c tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:07.092998 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-06e1fb27-93f5-4ec4-be5a-5918423fce7c tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c2fb208b56d4d52b59ac09873f16180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e8cac36a174b2eb5a6e53fdf25b4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:58:07.104184 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-bb134301-1750-4fa4-bafe-def4598b79db tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-641705955", "imageRef": "dcacad62-e278-4869-aa20-e5df07dd03db", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c010dc4d-023b-4979-a482-d3b3e0924e91"}], "security_groups": [{"name": "tempest-securitygroup--1352716442"}], "key_name": "tempest-keypair-67106449", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:58:07.104591 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-06e1fb27-93f5-4ec4-be5a-5918423fce7c tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59" status: 200 len: 1296 microversion: 2.1 time: 0.244048 May 26 14:58:07.111021 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 30/64] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:58:06 2021] GET /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59 => generated 1296 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:58:07.691117 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [req-14a21ae2-bb65-46bd-89f4-993085592dae req-00812007-b354-482a-bbc7-7472e1815360 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b37b708-5d64-4e1f-9e17-32f528641ca5", "name": "network-vif-plugged", "status": "completed", "tag": "24b593cd-0651-4f0f-aa78-c431b4dbb3f1"}]} {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:58:07.693409 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 14:58:07.693409 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: warnings.warn(msg) May 26 14:58:07.701843 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [req-14a21ae2-bb65-46bd-89f4-993085592dae req-00812007-b354-482a-bbc7-7472e1815360 service nova] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:07.702302 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [req-14a21ae2-bb65-46bd-89f4-993085592dae req-00812007-b354-482a-bbc7-7472e1815360 service nova] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:07.722933 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.compute.server_external_events [req-14a21ae2-bb65-46bd-89f4-993085592dae req-00812007-b354-482a-bbc7-7472e1815360 service nova] Creating event network-vif-plugged:24b593cd-0651-4f0f-aa78-c431b4dbb3f1 for instance 2b37b708-5d64-4e1f-9e17-32f528641ca5 on hv-cinder-78414 May 26 14:58:07.723706 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [req-14a21ae2-bb65-46bd-89f4-993085592dae req-00812007-b354-482a-bbc7-7472e1815360 service nova] Acquired lock "compute-rpcapi-router" {{(pid=118514) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} May 26 14:58:07.725215 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-99bb2451-3401-4c75-a3f4-06234e1dee73 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:07.726195 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-99bb2451-3401-4c75-a3f4-06234e1dee73 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:07.727243 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-99bb2451-3401-4c75-a3f4-06234e1dee73 None None] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:07.727924 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-99bb2451-3401-4c75-a3f4-06234e1dee73 None None] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:07.728902 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.network.neutron [None req-bb134301-1750-4fa4-bafe-def4598b79db tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] validate_networks() for [('c010dc4d-023b-4979-a482-d3b3e0924e91', None, None, None)] {{(pid=118513) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} May 26 14:58:07.739019 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.compute.rpcapi [None req-99bb2451-3401-4c75-a3f4-06234e1dee73 None None] Automatically selected compute RPC version 6.0 from minimum service version 56 May 26 14:58:07.740573 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-99bb2451-3401-4c75-a3f4-06234e1dee73 None None] Releasing lock "compute-rpcapi-router" {{(pid=118514) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} May 26 14:58:07.779432 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-99bb2451-3401-4c75-a3f4-06234e1dee73 None None] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.498016 May 26 14:58:07.779432 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 31/65] 10.222.0.81 () {64 vars in 1318 bytes} [Wed May 26 14:58:07 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:58:07.789534 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-062ef03a-d73a-4510-b145-9c60a8bfb8ff tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:58:07.790852 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-062ef03a-d73a-4510-b145-9c60a8bfb8ff tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] [instance: acc03344-b5df-4277-82e4-c9b3228969ca] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:58:07.817031 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-062ef03a-d73a-4510-b145-9c60a8bfb8ff tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:07.818080 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-062ef03a-d73a-4510-b145-9c60a8bfb8ff tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:07.819873 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-062ef03a-d73a-4510-b145-9c60a8bfb8ff tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:07.820652 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-062ef03a-d73a-4510-b145-9c60a8bfb8ff tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:07.986500 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-062ef03a-d73a-4510-b145-9c60a8bfb8ff tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b167942c895345b186a3eda5c82175b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad2ab2705ca479ab4aaafe7c80de162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:58:08.002995 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-062ef03a-d73a-4510-b145-9c60a8bfb8ff tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /compute/v2.1/servers/acc03344-b5df-4277-82e4-c9b3228969ca" status: 200 len: 1280 microversion: 2.1 time: 0.221506 May 26 14:58:08.009305 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 32/66] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:58:07 2021] GET /compute/v2.1/servers/acc03344-b5df-4277-82e4-c9b3228969ca => generated 1280 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:58:08.020883 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-84369dfe-ea88-46d5-baf4-106505695eb8 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:58:08.020883 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-84369dfe-ea88-46d5-baf4-106505695eb8 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] [instance: 2b37b708-5d64-4e1f-9e17-32f528641ca5] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:58:08.029696 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-84369dfe-ea88-46d5-baf4-106505695eb8 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:08.030450 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-84369dfe-ea88-46d5-baf4-106505695eb8 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:08.031752 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-84369dfe-ea88-46d5-baf4-106505695eb8 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:08.032374 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-84369dfe-ea88-46d5-baf4-106505695eb8 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:08.720559 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-84369dfe-ea88-46d5-baf4-106505695eb8 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d6fb430257a489c8b8a1890ecb5ea93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f665681e524725b9abb121531f47a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:58:08.733605 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-84369dfe-ea88-46d5-baf4-106505695eb8 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] 10.222.0.81 "GET /compute/v2.1/servers/2b37b708-5d64-4e1f-9e17-32f528641ca5" status: 200 len: 1314 microversion: 2.1 time: 0.722795 May 26 14:58:08.734530 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 33/67] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:58:08 2021] GET /compute/v2.1/servers/2b37b708-5d64-4e1f-9e17-32f528641ca5 => generated 1314 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:58:08.747223 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-8a6d0a1d-87c0-439e-a802-772c1fa1691d tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:58:08.747868 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-8a6d0a1d-87c0-439e-a802-772c1fa1691d tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: a9d8f9a6-bd66-4caa-8662-4bb94655ae59] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:58:08.801123 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-8a6d0a1d-87c0-439e-a802-772c1fa1691d tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:08.802401 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-8a6d0a1d-87c0-439e-a802-772c1fa1691d tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:08.804159 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-8a6d0a1d-87c0-439e-a802-772c1fa1691d tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:08.805561 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-8a6d0a1d-87c0-439e-a802-772c1fa1691d tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:09.698937 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.virt.hardware [None req-bb134301-1750-4fa4-bafe-def4598b79db tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Flavor limits 0:0:0 {{(pid=118513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} May 26 14:58:09.699400 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.virt.hardware [None req-bb134301-1750-4fa4-bafe-def4598b79db tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Image limits 0:0:0 {{(pid=118513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} May 26 14:58:09.700318 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.virt.hardware [None req-bb134301-1750-4fa4-bafe-def4598b79db tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Flavor pref 0:0:0 {{(pid=118513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} May 26 14:58:09.700318 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.virt.hardware [None req-bb134301-1750-4fa4-bafe-def4598b79db tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Image pref 0:0:0 {{(pid=118513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} May 26 14:58:09.700722 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.virt.hardware [None req-bb134301-1750-4fa4-bafe-def4598b79db tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} May 26 14:58:09.712892 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-bb134301-1750-4fa4-bafe-def4598b79db tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:09.713365 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-bb134301-1750-4fa4-bafe-def4598b79db tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:09.714468 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-bb134301-1750-4fa4-bafe-def4598b79db tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:09.714707 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-bb134301-1750-4fa4-bafe-def4598b79db tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:09.738978 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.quota [None req-bb134301-1750-4fa4-bafe-def4598b79db tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Getting quotas for project 7555f6895a2a405685d8ccfe81fe5a74. Resources: {'instances', 'ram', 'cores'} {{(pid=118513) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 26 14:58:09.759657 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.quota [None req-bb134301-1750-4fa4-bafe-def4598b79db tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Getting quotas for user de739c6952a94c308a9cc89c738d8500 and project 7555f6895a2a405685d8ccfe81fe5a74. Resources: {'instances', 'ram', 'cores'} {{(pid=118513) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 26 14:58:09.784047 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-bb134301-1750-4fa4-bafe-def4598b79db tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Going to run 1 instances... {{(pid=118513) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 26 14:58:09.786478 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-bb134301-1750-4fa4-bafe-def4598b79db tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 598b0e3f-8cf1-451a-80a8-ed7e5dd36984] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dcacad62-e278-4869-aa20-e5df07dd03db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118513) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} May 26 14:58:09.802291 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-8a6d0a1d-87c0-439e-a802-772c1fa1691d tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c2fb208b56d4d52b59ac09873f16180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e8cac36a174b2eb5a6e53fdf25b4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:58:09.825037 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-8a6d0a1d-87c0-439e-a802-772c1fa1691d tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59" status: 200 len: 1364 microversion: 2.1 time: 1.080922 May 26 14:58:09.826822 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 34/68] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:58:08 2021] GET /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59 => generated 1364 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:58:09.839359 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-650cf999-c855-4d51-a26f-81f2d73e379d tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:58:09.841646 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-650cf999-c855-4d51-a26f-81f2d73e379d tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] [instance: acc03344-b5df-4277-82e4-c9b3228969ca] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:58:09.867451 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-650cf999-c855-4d51-a26f-81f2d73e379d tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:09.884915 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-650cf999-c855-4d51-a26f-81f2d73e379d tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:09.888633 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-650cf999-c855-4d51-a26f-81f2d73e379d tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:09.890755 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-650cf999-c855-4d51-a26f-81f2d73e379d tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:10.037969 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-bb134301-1750-4fa4-bafe-def4598b79db tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.941363 May 26 14:58:10.044315 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 35/69] 10.222.0.81 () {62 vars in 1188 bytes} [Wed May 26 14:58:07 2021] POST /compute/v2.1/servers => generated 402 bytes in 2948 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 26 14:58:10.049848 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-54644dd3-4f2d-46c5-b738-1bfd1513cf65 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:58:10.050480 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-54644dd3-4f2d-46c5-b738-1bfd1513cf65 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] [instance: 2b37b708-5d64-4e1f-9e17-32f528641ca5] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:58:10.058106 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-54644dd3-4f2d-46c5-b738-1bfd1513cf65 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:10.058569 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-54644dd3-4f2d-46c5-b738-1bfd1513cf65 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:10.059361 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-54644dd3-4f2d-46c5-b738-1bfd1513cf65 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:10.060018 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-54644dd3-4f2d-46c5-b738-1bfd1513cf65 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:10.494757 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-54644dd3-4f2d-46c5-b738-1bfd1513cf65 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d6fb430257a489c8b8a1890ecb5ea93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f665681e524725b9abb121531f47a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:58:10.504897 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-54644dd3-4f2d-46c5-b738-1bfd1513cf65 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] 10.222.0.81 "GET /compute/v2.1/servers/2b37b708-5d64-4e1f-9e17-32f528641ca5" status: 200 len: 1314 microversion: 2.1 time: 0.459211 May 26 14:58:10.505441 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 36/70] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:58:10 2021] GET /compute/v2.1/servers/2b37b708-5d64-4e1f-9e17-32f528641ca5 => generated 1314 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:58:10.513513 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-d59ebc32-93de-45e2-86b2-3091d52b884e tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:58:10.518501 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-d59ebc32-93de-45e2-86b2-3091d52b884e tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 598b0e3f-8cf1-451a-80a8-ed7e5dd36984] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:58:10.626240 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-650cf999-c855-4d51-a26f-81f2d73e379d tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b167942c895345b186a3eda5c82175b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad2ab2705ca479ab4aaafe7c80de162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:58:10.635386 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-650cf999-c855-4d51-a26f-81f2d73e379d tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /compute/v2.1/servers/acc03344-b5df-4277-82e4-c9b3228969ca" status: 200 len: 1322 microversion: 2.1 time: 0.806728 May 26 14:58:10.636250 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 35/71] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:58:09 2021] GET /compute/v2.1/servers/acc03344-b5df-4277-82e4-c9b3228969ca => generated 1322 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:58:10.708096 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-d59ebc32-93de-45e2-86b2-3091d52b884e tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:58:10.726641 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-d59ebc32-93de-45e2-86b2-3091d52b884e tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:58:10.727487 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-d59ebc32-93de-45e2-86b2-3091d52b884e tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:58:10.732855 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-d59ebc32-93de-45e2-86b2-3091d52b884e tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984" status: 200 len: 1279 microversion: 2.20 time: 0.219013 May 26 14:58:10.733486 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 37/72] 10.222.0.81 () {60 vars in 1277 bytes} [Wed May 26 14:58:10 2021] GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984 => generated 1279 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:58:10.844492 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-9dd0cc49-a83e-4ba1-8e38-7a0b0360fc6b tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:58:10.845453 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-9dd0cc49-a83e-4ba1-8e38-7a0b0360fc6b tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: a9d8f9a6-bd66-4caa-8662-4bb94655ae59] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:58:10.859791 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-9dd0cc49-a83e-4ba1-8e38-7a0b0360fc6b tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:10.860509 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-9dd0cc49-a83e-4ba1-8e38-7a0b0360fc6b tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:10.862811 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-9dd0cc49-a83e-4ba1-8e38-7a0b0360fc6b tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:10.863524 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-9dd0cc49-a83e-4ba1-8e38-7a0b0360fc6b tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:11.291108 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [req-ebe49a3e-ddc7-4aef-843d-174c9ec8e654 req-0bbf60cd-b36d-4537-88a5-cd6c1cd880f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa145a33-41b1-4e39-9642-132aca11fcfe", "tag": "be847840-0dc2-4457-bb7b-594e083f4912"}]} {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:58:11.297289 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 14:58:11.297289 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: warnings.warn(msg) May 26 14:58:11.305109 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [req-ebe49a3e-ddc7-4aef-843d-174c9ec8e654 req-0bbf60cd-b36d-4537-88a5-cd6c1cd880f5 service nova] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:11.305834 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [req-ebe49a3e-ddc7-4aef-843d-174c9ec8e654 req-0bbf60cd-b36d-4537-88a5-cd6c1cd880f5 service nova] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:11.324940 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.compute.server_external_events [req-ebe49a3e-ddc7-4aef-843d-174c9ec8e654 req-0bbf60cd-b36d-4537-88a5-cd6c1cd880f5 service nova] Creating event network-changed:be847840-0dc2-4457-bb7b-594e083f4912 for instance aa145a33-41b1-4e39-9642-132aca11fcfe on hv-cinder-78414 May 26 14:58:11.333179 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [req-ebe49a3e-ddc7-4aef-843d-174c9ec8e654 req-0bbf60cd-b36d-4537-88a5-cd6c1cd880f5 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046339 May 26 14:58:11.334648 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 38/73] 10.222.0.81 () {64 vars in 1318 bytes} [Wed May 26 14:58:11 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 14:58:11.351928 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-9dd0cc49-a83e-4ba1-8e38-7a0b0360fc6b tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c2fb208b56d4d52b59ac09873f16180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e8cac36a174b2eb5a6e53fdf25b4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:58:11.360418 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-9dd0cc49-a83e-4ba1-8e38-7a0b0360fc6b tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59" status: 200 len: 1364 microversion: 2.1 time: 0.520189 May 26 14:58:11.361220 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 36/74] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:58:10 2021] GET /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59 => generated 1364 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:58:11.525376 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-48d66510-9165-4564-aec9-fad5a3b43c2e tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:58:11.526125 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-48d66510-9165-4564-aec9-fad5a3b43c2e tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] [instance: 2b37b708-5d64-4e1f-9e17-32f528641ca5] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:58:11.546402 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-48d66510-9165-4564-aec9-fad5a3b43c2e tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:11.546871 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-48d66510-9165-4564-aec9-fad5a3b43c2e tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:11.554128 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-48d66510-9165-4564-aec9-fad5a3b43c2e tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:11.554128 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-48d66510-9165-4564-aec9-fad5a3b43c2e tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:11.656627 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-db35d451-75e6-48ef-a4cd-38c5ad8d33ea tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:58:11.656627 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-db35d451-75e6-48ef-a4cd-38c5ad8d33ea tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] [instance: acc03344-b5df-4277-82e4-c9b3228969ca] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:58:11.664375 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-db35d451-75e6-48ef-a4cd-38c5ad8d33ea tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:11.664841 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-db35d451-75e6-48ef-a4cd-38c5ad8d33ea tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:11.667795 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-db35d451-75e6-48ef-a4cd-38c5ad8d33ea tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:11.673814 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-db35d451-75e6-48ef-a4cd-38c5ad8d33ea tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:12.515162 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-db35d451-75e6-48ef-a4cd-38c5ad8d33ea tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b167942c895345b186a3eda5c82175b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad2ab2705ca479ab4aaafe7c80de162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:58:12.529656 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-db35d451-75e6-48ef-a4cd-38c5ad8d33ea tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /compute/v2.1/servers/acc03344-b5df-4277-82e4-c9b3228969ca" status: 200 len: 1322 microversion: 2.1 time: 0.878924 May 26 14:58:12.542880 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-48d66510-9165-4564-aec9-fad5a3b43c2e tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d6fb430257a489c8b8a1890ecb5ea93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f665681e524725b9abb121531f47a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:58:12.556382 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 37/75] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:58:11 2021] GET /compute/v2.1/servers/acc03344-b5df-4277-82e4-c9b3228969ca => generated 1322 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 14:58:12.566097 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-48d66510-9165-4564-aec9-fad5a3b43c2e tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] 10.222.0.81 "GET /compute/v2.1/servers/2b37b708-5d64-4e1f-9e17-32f528641ca5" status: 200 len: 1314 microversion: 2.1 time: 1.043275 May 26 14:58:12.566717 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 39/76] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:58:11 2021] GET /compute/v2.1/servers/2b37b708-5d64-4e1f-9e17-32f528641ca5 => generated 1314 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:58:12.575416 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-d0e56bb7-f3e5-4c16-994b-0602c6fb6e5b tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:58:12.576190 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-d0e56bb7-f3e5-4c16-994b-0602c6fb6e5b tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 598b0e3f-8cf1-451a-80a8-ed7e5dd36984] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:58:12.590640 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-d0e56bb7-f3e5-4c16-994b-0602c6fb6e5b tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:12.600183 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-d0e56bb7-f3e5-4c16-994b-0602c6fb6e5b tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:12.601124 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-d0e56bb7-f3e5-4c16-994b-0602c6fb6e5b tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:12.601601 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-d0e56bb7-f3e5-4c16-994b-0602c6fb6e5b tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:12.832448 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [req-ee7095eb-d1d3-4143-be69-b7eba19eccb2 req-21a4edb9-ff9c-46e9-a66d-fa75461f3542 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9d8f9a6-bd66-4caa-8662-4bb94655ae59", "tag": "5b77d4a0-1161-49af-829e-9c8b577a215a"}]} {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:58:12.834059 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 14:58:12.834059 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: warnings.warn(msg) May 26 14:58:12.852539 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [req-ee7095eb-d1d3-4143-be69-b7eba19eccb2 req-21a4edb9-ff9c-46e9-a66d-fa75461f3542 service nova] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:12.852994 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [req-ee7095eb-d1d3-4143-be69-b7eba19eccb2 req-21a4edb9-ff9c-46e9-a66d-fa75461f3542 service nova] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:12.890087 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.compute.server_external_events [req-ee7095eb-d1d3-4143-be69-b7eba19eccb2 req-21a4edb9-ff9c-46e9-a66d-fa75461f3542 service nova] Creating event network-changed:5b77d4a0-1161-49af-829e-9c8b577a215a for instance a9d8f9a6-bd66-4caa-8662-4bb94655ae59 on hv-cinder-78414 May 26 14:58:12.902372 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [req-ee7095eb-d1d3-4143-be69-b7eba19eccb2 req-21a4edb9-ff9c-46e9-a66d-fa75461f3542 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.331108 May 26 14:58:12.903538 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 40/77] 10.222.0.81 () {64 vars in 1318 bytes} [Wed May 26 14:58:12 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:58:12.916632 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-c92ab111-5698-4dc4-8944-4ffb831270e7 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:58:12.917513 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-c92ab111-5698-4dc4-8944-4ffb831270e7 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: a9d8f9a6-bd66-4caa-8662-4bb94655ae59] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:58:12.935282 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-c92ab111-5698-4dc4-8944-4ffb831270e7 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:12.937581 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-c92ab111-5698-4dc4-8944-4ffb831270e7 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:12.939557 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-c92ab111-5698-4dc4-8944-4ffb831270e7 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:12.939557 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-c92ab111-5698-4dc4-8944-4ffb831270e7 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:13.205324 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-d0e56bb7-f3e5-4c16-994b-0602c6fb6e5b tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:58:13.215834 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-d0e56bb7-f3e5-4c16-994b-0602c6fb6e5b tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:58:13.220046 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-d0e56bb7-f3e5-4c16-994b-0602c6fb6e5b tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:58:13.222236 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-d0e56bb7-f3e5-4c16-994b-0602c6fb6e5b tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984" status: 200 len: 1331 microversion: 2.20 time: 0.663861 May 26 14:58:13.226282 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 38/78] 10.222.0.81 () {60 vars in 1277 bytes} [Wed May 26 14:58:12 2021] GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984 => generated 1331 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:58:13.547662 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-888e31ab-0d43-4cd5-9b6d-db5f4088b088 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:58:13.547662 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-888e31ab-0d43-4cd5-9b6d-db5f4088b088 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] [instance: acc03344-b5df-4277-82e4-c9b3228969ca] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:58:13.560252 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-888e31ab-0d43-4cd5-9b6d-db5f4088b088 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:13.561355 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-888e31ab-0d43-4cd5-9b6d-db5f4088b088 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:13.563235 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-888e31ab-0d43-4cd5-9b6d-db5f4088b088 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:13.563594 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-888e31ab-0d43-4cd5-9b6d-db5f4088b088 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:13.620645 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-c92ab111-5698-4dc4-8944-4ffb831270e7 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c2fb208b56d4d52b59ac09873f16180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e8cac36a174b2eb5a6e53fdf25b4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:58:13.650714 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-c92ab111-5698-4dc4-8944-4ffb831270e7 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59" status: 200 len: 1364 microversion: 2.1 time: 0.744641 May 26 14:58:13.664614 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 41/79] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:58:12 2021] GET /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59 => generated 1364 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:58:13.679581 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-68882a87-5409-4e59-acc8-f7afe5c6dd6a tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:58:13.681589 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-68882a87-5409-4e59-acc8-f7afe5c6dd6a tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] [instance: 2b37b708-5d64-4e1f-9e17-32f528641ca5] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:58:13.698707 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-68882a87-5409-4e59-acc8-f7afe5c6dd6a tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:13.699573 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-68882a87-5409-4e59-acc8-f7afe5c6dd6a tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:13.700846 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-68882a87-5409-4e59-acc8-f7afe5c6dd6a tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:13.701653 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-68882a87-5409-4e59-acc8-f7afe5c6dd6a tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:14.139197 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-888e31ab-0d43-4cd5-9b6d-db5f4088b088 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b167942c895345b186a3eda5c82175b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad2ab2705ca479ab4aaafe7c80de162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:58:14.148471 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-888e31ab-0d43-4cd5-9b6d-db5f4088b088 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /compute/v2.1/servers/acc03344-b5df-4277-82e4-c9b3228969ca" status: 200 len: 1322 microversion: 2.1 time: 0.606452 May 26 14:58:14.149295 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 39/80] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:58:13 2021] GET /compute/v2.1/servers/acc03344-b5df-4277-82e4-c9b3228969ca => generated 1322 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 14:58:14.203690 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-68882a87-5409-4e59-acc8-f7afe5c6dd6a tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d6fb430257a489c8b8a1890ecb5ea93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f665681e524725b9abb121531f47a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:58:14.220265 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-68882a87-5409-4e59-acc8-f7afe5c6dd6a tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] 10.222.0.81 "GET /compute/v2.1/servers/2b37b708-5d64-4e1f-9e17-32f528641ca5" status: 200 len: 1499 microversion: 2.1 time: 0.553526 May 26 14:58:14.221976 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 42/81] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:58:13 2021] GET /compute/v2.1/servers/2b37b708-5d64-4e1f-9e17-32f528641ca5 => generated 1499 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:58:14.240637 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-cf416b53-fab0-47ed-add4-498decacd6f1 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:58:14.245762 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-cf416b53-fab0-47ed-add4-498decacd6f1 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 598b0e3f-8cf1-451a-80a8-ed7e5dd36984] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:58:14.261291 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-cf416b53-fab0-47ed-add4-498decacd6f1 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:14.264864 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-cf416b53-fab0-47ed-add4-498decacd6f1 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:14.265985 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-cf416b53-fab0-47ed-add4-498decacd6f1 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:14.266659 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-cf416b53-fab0-47ed-add4-498decacd6f1 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:14.532649 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-cf416b53-fab0-47ed-add4-498decacd6f1 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:58:14.551716 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-cf416b53-fab0-47ed-add4-498decacd6f1 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:58:14.554405 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-cf416b53-fab0-47ed-add4-498decacd6f1 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:58:14.555723 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-cf416b53-fab0-47ed-add4-498decacd6f1 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984" status: 200 len: 1337 microversion: 2.20 time: 0.318890 May 26 14:58:14.556940 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 40/82] 10.222.0.81 () {60 vars in 1277 bytes} [Wed May 26 14:58:14 2021] GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984 => generated 1337 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:58:14.673731 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-37c58818-1c8b-44bb-98fb-447f83ce43bb tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:58:14.679168 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-37c58818-1c8b-44bb-98fb-447f83ce43bb tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: a9d8f9a6-bd66-4caa-8662-4bb94655ae59] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:58:14.684269 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-37c58818-1c8b-44bb-98fb-447f83ce43bb tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:14.684727 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-37c58818-1c8b-44bb-98fb-447f83ce43bb tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:14.685731 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-37c58818-1c8b-44bb-98fb-447f83ce43bb tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:14.686338 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-37c58818-1c8b-44bb-98fb-447f83ce43bb tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:14.930679 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-37c58818-1c8b-44bb-98fb-447f83ce43bb tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c2fb208b56d4d52b59ac09873f16180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e8cac36a174b2eb5a6e53fdf25b4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:58:14.944734 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-37c58818-1c8b-44bb-98fb-447f83ce43bb tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59" status: 200 len: 1364 microversion: 2.1 time: 0.277791 May 26 14:58:14.970462 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 43/83] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:58:14 2021] GET /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59 => generated 1364 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:58:14.981218 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [req-f75bed49-033b-4228-b4ee-f1ce3fdd0ba3 req-9ef016ec-cd45-4190-a507-8c663e30022f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "acc03344-b5df-4277-82e4-c9b3228969ca", "tag": "0cdf2872-b922-4d87-8260-bb3c5b2a449b"}]} {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:58:14.983968 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 14:58:14.983968 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: warnings.warn(msg) May 26 14:58:14.999205 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [req-f75bed49-033b-4228-b4ee-f1ce3fdd0ba3 req-9ef016ec-cd45-4190-a507-8c663e30022f service nova] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:15.000408 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [req-f75bed49-033b-4228-b4ee-f1ce3fdd0ba3 req-9ef016ec-cd45-4190-a507-8c663e30022f service nova] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:15.023138 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.compute.server_external_events [req-f75bed49-033b-4228-b4ee-f1ce3fdd0ba3 req-9ef016ec-cd45-4190-a507-8c663e30022f service nova] Creating event network-changed:0cdf2872-b922-4d87-8260-bb3c5b2a449b for instance acc03344-b5df-4277-82e4-c9b3228969ca on hv-cinder-78414 May 26 14:58:15.029253 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [req-f75bed49-033b-4228-b4ee-f1ce3fdd0ba3 req-9ef016ec-cd45-4190-a507-8c663e30022f service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053577 May 26 14:58:15.030545 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 41/84] 10.222.0.81 () {64 vars in 1318 bytes} [Wed May 26 14:58:14 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:58:15.168222 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-b45e4164-1439-4ac7-bf41-7aa8077b0f24 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:58:15.169004 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-b45e4164-1439-4ac7-bf41-7aa8077b0f24 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] [instance: acc03344-b5df-4277-82e4-c9b3228969ca] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:58:15.182746 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-b45e4164-1439-4ac7-bf41-7aa8077b0f24 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:15.183537 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-b45e4164-1439-4ac7-bf41-7aa8077b0f24 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:15.184836 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-b45e4164-1439-4ac7-bf41-7aa8077b0f24 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:15.185424 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-b45e4164-1439-4ac7-bf41-7aa8077b0f24 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:15.574882 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-cabf466c-0511-49b2-bd16-fddca5014c23 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:58:15.575658 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-cabf466c-0511-49b2-bd16-fddca5014c23 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 598b0e3f-8cf1-451a-80a8-ed7e5dd36984] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:58:15.591513 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-cabf466c-0511-49b2-bd16-fddca5014c23 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:15.592658 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-cabf466c-0511-49b2-bd16-fddca5014c23 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:15.593515 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-cabf466c-0511-49b2-bd16-fddca5014c23 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:15.594001 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-cabf466c-0511-49b2-bd16-fddca5014c23 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:16.462008 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-b45e4164-1439-4ac7-bf41-7aa8077b0f24 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b167942c895345b186a3eda5c82175b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad2ab2705ca479ab4aaafe7c80de162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:58:16.469374 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-b45e4164-1439-4ac7-bf41-7aa8077b0f24 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /compute/v2.1/servers/acc03344-b5df-4277-82e4-c9b3228969ca" status: 200 len: 1322 microversion: 2.1 time: 1.306132 May 26 14:58:16.482861 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 44/85] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:58:15 2021] GET /compute/v2.1/servers/acc03344-b5df-4277-82e4-c9b3228969ca => generated 1322 bytes in 1320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:58:16.487733 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-b6e39f46-32c6-4f91-a7f9-657366f6acc9 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:58:16.493412 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-b6e39f46-32c6-4f91-a7f9-657366f6acc9 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: a9d8f9a6-bd66-4caa-8662-4bb94655ae59] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:58:16.507998 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-b6e39f46-32c6-4f91-a7f9-657366f6acc9 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:16.511844 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-b6e39f46-32c6-4f91-a7f9-657366f6acc9 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:16.513951 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-b6e39f46-32c6-4f91-a7f9-657366f6acc9 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:16.515558 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-b6e39f46-32c6-4f91-a7f9-657366f6acc9 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:16.546593 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-cabf466c-0511-49b2-bd16-fddca5014c23 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:58:16.561324 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-cabf466c-0511-49b2-bd16-fddca5014c23 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:58:16.579728 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-cabf466c-0511-49b2-bd16-fddca5014c23 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:58:16.579728 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-cabf466c-0511-49b2-bd16-fddca5014c23 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984" status: 200 len: 1405 microversion: 2.20 time: 1.008545 May 26 14:58:16.598512 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 42/86] 10.222.0.81 () {60 vars in 1277 bytes} [Wed May 26 14:58:15 2021] GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984 => generated 1405 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 14:58:16.887809 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-b6e39f46-32c6-4f91-a7f9-657366f6acc9 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c2fb208b56d4d52b59ac09873f16180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e8cac36a174b2eb5a6e53fdf25b4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:58:16.898090 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-b6e39f46-32c6-4f91-a7f9-657366f6acc9 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59" status: 200 len: 1364 microversion: 2.1 time: 0.413926 May 26 14:58:16.903588 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 45/87] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:58:16 2021] GET /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59 => generated 1364 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:58:17.044853 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-bed16b01-20b3-4643-8c86-a583c7ceed62 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4f4dedf4-9619-41c2-8e19-e4e81424e3be"}} {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:58:17.046902 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-bed16b01-20b3-4643-8c86-a583c7ceed62 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] [instance: 2b37b708-5d64-4e1f-9e17-32f528641ca5] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:58:17.060031 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-bed16b01-20b3-4643-8c86-a583c7ceed62 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:17.061836 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-bed16b01-20b3-4643-8c86-a583c7ceed62 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:17.062893 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-bed16b01-20b3-4643-8c86-a583c7ceed62 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:17.063616 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-bed16b01-20b3-4643-8c86-a583c7ceed62 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:17.474362 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [req-ec6abb2d-e092-432f-bac4-8c1a8f0ad5c5 req-c18e221c-5b58-4f87-a71b-5fbfa383de08 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "598b0e3f-8cf1-451a-80a8-ed7e5dd36984", "tag": "e948d481-711f-45b8-8deb-08b7658709e7"}]} {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:58:17.476576 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 14:58:17.476576 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: warnings.warn(msg) May 26 14:58:17.494893 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [req-ec6abb2d-e092-432f-bac4-8c1a8f0ad5c5 req-c18e221c-5b58-4f87-a71b-5fbfa383de08 service nova] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:17.495700 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [req-ec6abb2d-e092-432f-bac4-8c1a8f0ad5c5 req-c18e221c-5b58-4f87-a71b-5fbfa383de08 service nova] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:17.521527 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.compute.server_external_events [req-ec6abb2d-e092-432f-bac4-8c1a8f0ad5c5 req-c18e221c-5b58-4f87-a71b-5fbfa383de08 service nova] Creating event network-changed:e948d481-711f-45b8-8deb-08b7658709e7 for instance 598b0e3f-8cf1-451a-80a8-ed7e5dd36984 on hv-cinder-78414 May 26 14:58:17.527120 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [req-ec6abb2d-e092-432f-bac4-8c1a8f0ad5c5 req-c18e221c-5b58-4f87-a71b-5fbfa383de08 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058696 May 26 14:58:17.528196 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 46/88] 10.222.0.81 () {64 vars in 1318 bytes} [Wed May 26 14:58:17 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:58:17.536569 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-f9999a3c-001f-41ec-9809-686aece14d17 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:58:17.542227 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-f9999a3c-001f-41ec-9809-686aece14d17 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] [instance: acc03344-b5df-4277-82e4-c9b3228969ca] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:58:17.604520 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-f9999a3c-001f-41ec-9809-686aece14d17 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:17.605322 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-f9999a3c-001f-41ec-9809-686aece14d17 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:17.609915 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-f9999a3c-001f-41ec-9809-686aece14d17 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:17.610547 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-f9999a3c-001f-41ec-9809-686aece14d17 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:17.988657 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-f9999a3c-001f-41ec-9809-686aece14d17 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b167942c895345b186a3eda5c82175b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad2ab2705ca479ab4aaafe7c80de162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:58:17.999147 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-f9999a3c-001f-41ec-9809-686aece14d17 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /compute/v2.1/servers/acc03344-b5df-4277-82e4-c9b3228969ca" status: 200 len: 1322 microversion: 2.1 time: 0.468730 May 26 14:58:18.013571 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 47/89] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:58:17 2021] GET /compute/v2.1/servers/acc03344-b5df-4277-82e4-c9b3228969ca => generated 1322 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:58:18.013571 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-3acb08e4-7509-40e7-815b-daaf63eac52d tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:58:18.014238 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-3acb08e4-7509-40e7-815b-daaf63eac52d tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 598b0e3f-8cf1-451a-80a8-ed7e5dd36984] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:58:18.025999 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-3acb08e4-7509-40e7-815b-daaf63eac52d tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:18.026614 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-3acb08e4-7509-40e7-815b-daaf63eac52d tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:18.028005 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-3acb08e4-7509-40e7-815b-daaf63eac52d tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:18.028584 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-3acb08e4-7509-40e7-815b-daaf63eac52d tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:18.322802 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-3acb08e4-7509-40e7-815b-daaf63eac52d tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:58:18.333311 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-3acb08e4-7509-40e7-815b-daaf63eac52d tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:58:18.335001 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-3acb08e4-7509-40e7-815b-daaf63eac52d tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:58:18.336175 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-3acb08e4-7509-40e7-815b-daaf63eac52d tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984" status: 200 len: 1405 microversion: 2.20 time: 0.332613 May 26 14:58:18.346874 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 48/90] 10.222.0.81 () {60 vars in 1277 bytes} [Wed May 26 14:58:18 2021] GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984 => generated 1405 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:58:18.346874 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-590a9605-4a0a-477d-a1e2-9ae38fdb0201 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:58:18.346874 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-590a9605-4a0a-477d-a1e2-9ae38fdb0201 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: a9d8f9a6-bd66-4caa-8662-4bb94655ae59] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:58:18.351130 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-590a9605-4a0a-477d-a1e2-9ae38fdb0201 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:18.351655 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-590a9605-4a0a-477d-a1e2-9ae38fdb0201 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:18.352544 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-590a9605-4a0a-477d-a1e2-9ae38fdb0201 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:18.353058 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-590a9605-4a0a-477d-a1e2-9ae38fdb0201 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:18.371185 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-bed16b01-20b3-4643-8c86-a583c7ceed62 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] 10.222.0.81 "POST /compute/v2.1/servers/2b37b708-5d64-4e1f-9e17-32f528641ca5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.334101 May 26 14:58:18.373099 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 43/91] 10.222.0.81 () {60 vars in 1323 bytes} [Wed May 26 14:58:17 2021] POST /compute/v2.1/servers/2b37b708-5d64-4e1f-9e17-32f528641ca5/os-volume_attachments => generated 194 bytes in 1337 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:58:18.651276 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-590a9605-4a0a-477d-a1e2-9ae38fdb0201 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c2fb208b56d4d52b59ac09873f16180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e8cac36a174b2eb5a6e53fdf25b4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:58:18.661200 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-590a9605-4a0a-477d-a1e2-9ae38fdb0201 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59" status: 200 len: 1364 microversion: 2.1 time: 0.322819 May 26 14:58:18.662519 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 49/92] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:58:18 2021] GET /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59 => generated 1364 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:58:19.027079 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-675342dd-5645-426f-934d-f11fa9b21175 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:58:19.028051 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-675342dd-5645-426f-934d-f11fa9b21175 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] [instance: acc03344-b5df-4277-82e4-c9b3228969ca] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:58:19.036548 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-675342dd-5645-426f-934d-f11fa9b21175 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:19.037008 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-675342dd-5645-426f-934d-f11fa9b21175 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:19.037830 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-675342dd-5645-426f-934d-f11fa9b21175 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:19.038279 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-675342dd-5645-426f-934d-f11fa9b21175 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:19.354526 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-cd9cd9b1-c02e-411a-86f6-7e29bed8fb62 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:58:19.355147 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-cd9cd9b1-c02e-411a-86f6-7e29bed8fb62 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 598b0e3f-8cf1-451a-80a8-ed7e5dd36984] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:58:19.369370 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-cd9cd9b1-c02e-411a-86f6-7e29bed8fb62 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:19.370242 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-cd9cd9b1-c02e-411a-86f6-7e29bed8fb62 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:19.372110 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-cd9cd9b1-c02e-411a-86f6-7e29bed8fb62 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:19.372818 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-cd9cd9b1-c02e-411a-86f6-7e29bed8fb62 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:19.377163 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-675342dd-5645-426f-934d-f11fa9b21175 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b167942c895345b186a3eda5c82175b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad2ab2705ca479ab4aaafe7c80de162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:58:19.391971 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-675342dd-5645-426f-934d-f11fa9b21175 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /compute/v2.1/servers/acc03344-b5df-4277-82e4-c9b3228969ca" status: 200 len: 1322 microversion: 2.1 time: 0.369556 May 26 14:58:19.392925 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 44/93] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:58:19 2021] GET /compute/v2.1/servers/acc03344-b5df-4277-82e4-c9b3228969ca => generated 1322 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:58:19.678741 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-52b6242e-ad89-4fe3-b9b2-0418c3129f29 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:58:19.681126 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-52b6242e-ad89-4fe3-b9b2-0418c3129f29 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: a9d8f9a6-bd66-4caa-8662-4bb94655ae59] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:58:19.689223 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-52b6242e-ad89-4fe3-b9b2-0418c3129f29 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:19.690554 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-52b6242e-ad89-4fe3-b9b2-0418c3129f29 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:19.691567 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-52b6242e-ad89-4fe3-b9b2-0418c3129f29 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:19.692213 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-52b6242e-ad89-4fe3-b9b2-0418c3129f29 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:19.772344 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-cd9cd9b1-c02e-411a-86f6-7e29bed8fb62 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:58:19.786598 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-cd9cd9b1-c02e-411a-86f6-7e29bed8fb62 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:58:19.788187 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-cd9cd9b1-c02e-411a-86f6-7e29bed8fb62 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:58:19.789506 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-cd9cd9b1-c02e-411a-86f6-7e29bed8fb62 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984" status: 200 len: 1405 microversion: 2.20 time: 0.438490 May 26 14:58:19.805096 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 50/94] 10.222.0.81 () {60 vars in 1277 bytes} [Wed May 26 14:58:19 2021] GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984 => generated 1405 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:58:20.007774 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-52b6242e-ad89-4fe3-b9b2-0418c3129f29 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c2fb208b56d4d52b59ac09873f16180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e8cac36a174b2eb5a6e53fdf25b4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:58:20.015928 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-52b6242e-ad89-4fe3-b9b2-0418c3129f29 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59" status: 200 len: 1364 microversion: 2.1 time: 0.341053 May 26 14:58:20.016498 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 45/95] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:58:19 2021] GET /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59 => generated 1364 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:58:20.408379 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-f7e3cb79-e95f-4471-a778-c06020ab2a6b tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:58:20.409755 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-f7e3cb79-e95f-4471-a778-c06020ab2a6b tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] [instance: acc03344-b5df-4277-82e4-c9b3228969ca] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:58:20.417123 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-f7e3cb79-e95f-4471-a778-c06020ab2a6b tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:20.419441 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-f7e3cb79-e95f-4471-a778-c06020ab2a6b tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:20.419441 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-f7e3cb79-e95f-4471-a778-c06020ab2a6b tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:20.419441 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-f7e3cb79-e95f-4471-a778-c06020ab2a6b tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:20.640556 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-f7e3cb79-e95f-4471-a778-c06020ab2a6b tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b167942c895345b186a3eda5c82175b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad2ab2705ca479ab4aaafe7c80de162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:58:20.650212 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-f7e3cb79-e95f-4471-a778-c06020ab2a6b tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /compute/v2.1/servers/acc03344-b5df-4277-82e4-c9b3228969ca" status: 200 len: 1322 microversion: 2.1 time: 0.245578 May 26 14:58:20.661090 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 51/96] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:58:20 2021] GET /compute/v2.1/servers/acc03344-b5df-4277-82e4-c9b3228969ca => generated 1322 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:58:20.808450 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-43db613f-afeb-4d3b-86c3-07eb3b1c157e tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:58:20.813432 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-43db613f-afeb-4d3b-86c3-07eb3b1c157e tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 598b0e3f-8cf1-451a-80a8-ed7e5dd36984] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:58:20.819762 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-43db613f-afeb-4d3b-86c3-07eb3b1c157e tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:20.820403 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-43db613f-afeb-4d3b-86c3-07eb3b1c157e tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:20.821364 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-43db613f-afeb-4d3b-86c3-07eb3b1c157e tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:20.822111 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-43db613f-afeb-4d3b-86c3-07eb3b1c157e tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:21.036161 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-4f583bf2-2109-4d18-9c5f-173d316a0cb8 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:58:21.036796 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-4f583bf2-2109-4d18-9c5f-173d316a0cb8 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: a9d8f9a6-bd66-4caa-8662-4bb94655ae59] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:58:21.051100 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-4f583bf2-2109-4d18-9c5f-173d316a0cb8 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:21.051600 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-4f583bf2-2109-4d18-9c5f-173d316a0cb8 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:21.052575 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-4f583bf2-2109-4d18-9c5f-173d316a0cb8 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:21.053229 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-4f583bf2-2109-4d18-9c5f-173d316a0cb8 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:21.202339 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-43db613f-afeb-4d3b-86c3-07eb3b1c157e tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:58:21.211959 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-43db613f-afeb-4d3b-86c3-07eb3b1c157e tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:58:21.213847 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-43db613f-afeb-4d3b-86c3-07eb3b1c157e tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:58:21.215134 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-43db613f-afeb-4d3b-86c3-07eb3b1c157e tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984" status: 200 len: 1405 microversion: 2.20 time: 0.410825 May 26 14:58:21.221924 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 46/97] 10.222.0.81 () {60 vars in 1277 bytes} [Wed May 26 14:58:20 2021] GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984 => generated 1405 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:58:21.227914 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [req-2b548580-e962-4711-a378-cfe14360f573 req-705df25e-9045-492c-9e80-a91923bff5f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9d8f9a6-bd66-4caa-8662-4bb94655ae59", "name": "network-vif-plugged", "status": "completed", "tag": "5b77d4a0-1161-49af-829e-9c8b577a215a"}]} {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:58:21.229754 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 14:58:21.229754 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: warnings.warn(msg) May 26 14:58:21.239271 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [req-2b548580-e962-4711-a378-cfe14360f573 req-705df25e-9045-492c-9e80-a91923bff5f8 service nova] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:21.239923 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [req-2b548580-e962-4711-a378-cfe14360f573 req-705df25e-9045-492c-9e80-a91923bff5f8 service nova] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:21.259552 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.compute.server_external_events [req-2b548580-e962-4711-a378-cfe14360f573 req-705df25e-9045-492c-9e80-a91923bff5f8 service nova] Creating event network-vif-plugged:5b77d4a0-1161-49af-829e-9c8b577a215a for instance a9d8f9a6-bd66-4caa-8662-4bb94655ae59 on hv-cinder-78414 May 26 14:58:21.264497 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [req-2b548580-e962-4711-a378-cfe14360f573 req-705df25e-9045-492c-9e80-a91923bff5f8 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047093 May 26 14:58:21.265408 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 47/98] 10.222.0.81 () {64 vars in 1318 bytes} [Wed May 26 14:58:21 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:58:21.294105 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-4f583bf2-2109-4d18-9c5f-173d316a0cb8 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c2fb208b56d4d52b59ac09873f16180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e8cac36a174b2eb5a6e53fdf25b4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:58:21.302874 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-4f583bf2-2109-4d18-9c5f-173d316a0cb8 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59" status: 200 len: 1364 microversion: 2.1 time: 0.272216 May 26 14:58:21.309722 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 52/99] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:58:21 2021] GET /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59 => generated 1364 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 14:58:21.669052 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-3c7dba8e-d872-47de-8d66-331eb856f6c3 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:58:21.669801 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-3c7dba8e-d872-47de-8d66-331eb856f6c3 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] [instance: acc03344-b5df-4277-82e4-c9b3228969ca] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:58:21.677984 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-3c7dba8e-d872-47de-8d66-331eb856f6c3 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:21.678653 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-3c7dba8e-d872-47de-8d66-331eb856f6c3 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:21.679612 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-3c7dba8e-d872-47de-8d66-331eb856f6c3 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:21.680085 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-3c7dba8e-d872-47de-8d66-331eb856f6c3 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:21.917380 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-3c7dba8e-d872-47de-8d66-331eb856f6c3 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b167942c895345b186a3eda5c82175b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad2ab2705ca479ab4aaafe7c80de162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:58:21.927496 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-3c7dba8e-d872-47de-8d66-331eb856f6c3 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /compute/v2.1/servers/acc03344-b5df-4277-82e4-c9b3228969ca" status: 200 len: 1322 microversion: 2.1 time: 0.263282 May 26 14:58:21.928143 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 48/100] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:58:21 2021] GET /compute/v2.1/servers/acc03344-b5df-4277-82e4-c9b3228969ca => generated 1322 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:58:22.233613 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-c6a05dd4-7e9f-4d13-9ed8-31a498658ef6 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:58:22.238603 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-c6a05dd4-7e9f-4d13-9ed8-31a498658ef6 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 598b0e3f-8cf1-451a-80a8-ed7e5dd36984] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:58:22.242475 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-c6a05dd4-7e9f-4d13-9ed8-31a498658ef6 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:22.242925 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-c6a05dd4-7e9f-4d13-9ed8-31a498658ef6 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:22.243701 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-c6a05dd4-7e9f-4d13-9ed8-31a498658ef6 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:22.244146 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-c6a05dd4-7e9f-4d13-9ed8-31a498658ef6 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:22.323176 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-c4c2a625-6122-4ea1-ae90-db64949203d2 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:58:22.325950 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-c4c2a625-6122-4ea1-ae90-db64949203d2 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: a9d8f9a6-bd66-4caa-8662-4bb94655ae59] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:58:22.334674 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-c4c2a625-6122-4ea1-ae90-db64949203d2 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:22.335131 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-c4c2a625-6122-4ea1-ae90-db64949203d2 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:22.335925 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-c4c2a625-6122-4ea1-ae90-db64949203d2 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:22.336402 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-c4c2a625-6122-4ea1-ae90-db64949203d2 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:22.487566 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-c6a05dd4-7e9f-4d13-9ed8-31a498658ef6 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:58:22.498035 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-c6a05dd4-7e9f-4d13-9ed8-31a498658ef6 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:58:22.499589 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-c6a05dd4-7e9f-4d13-9ed8-31a498658ef6 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:58:22.500896 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-c6a05dd4-7e9f-4d13-9ed8-31a498658ef6 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984" status: 200 len: 1405 microversion: 2.20 time: 0.270773 May 26 14:58:22.512159 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 53/101] 10.222.0.81 () {60 vars in 1277 bytes} [Wed May 26 14:58:22 2021] GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984 => generated 1405 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:58:22.587569 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-c4c2a625-6122-4ea1-ae90-db64949203d2 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c2fb208b56d4d52b59ac09873f16180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e8cac36a174b2eb5a6e53fdf25b4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:58:22.599378 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-c4c2a625-6122-4ea1-ae90-db64949203d2 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59" status: 200 len: 1364 microversion: 2.1 time: 0.283154 May 26 14:58:22.599956 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 49/102] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:58:22 2021] GET /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59 => generated 1364 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 14:58:22.944617 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-7c2f3364-c1a4-41c9-adf9-856f802ae301 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:58:22.945236 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-7c2f3364-c1a4-41c9-adf9-856f802ae301 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] [instance: acc03344-b5df-4277-82e4-c9b3228969ca] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:58:22.953354 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-7c2f3364-c1a4-41c9-adf9-856f802ae301 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:22.953853 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-7c2f3364-c1a4-41c9-adf9-856f802ae301 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:22.954637 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-7c2f3364-c1a4-41c9-adf9-856f802ae301 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:22.955122 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-7c2f3364-c1a4-41c9-adf9-856f802ae301 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:23.177433 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-7c2f3364-c1a4-41c9-adf9-856f802ae301 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b167942c895345b186a3eda5c82175b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad2ab2705ca479ab4aaafe7c80de162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:58:23.187320 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-7c2f3364-c1a4-41c9-adf9-856f802ae301 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /compute/v2.1/servers/acc03344-b5df-4277-82e4-c9b3228969ca" status: 200 len: 1322 microversion: 2.1 time: 0.246327 May 26 14:58:23.197525 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 54/103] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:58:22 2021] GET /compute/v2.1/servers/acc03344-b5df-4277-82e4-c9b3228969ca => generated 1322 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:58:23.285529 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [req-cfc54aaf-835c-4178-8338-9f468069d7b0 req-20b0567f-9ae7-45ef-a24a-c346af3b8131 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acc03344-b5df-4277-82e4-c9b3228969ca", "name": "network-vif-plugged", "status": "completed", "tag": "0cdf2872-b922-4d87-8260-bb3c5b2a449b"}, {"server_uuid": "aa145a33-41b1-4e39-9642-132aca11fcfe", "name": "network-vif-plugged", "status": "completed", "tag": "be847840-0dc2-4457-bb7b-594e083f4912"}]} {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:58:23.288640 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 14:58:23.288640 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: warnings.warn(msg) May 26 14:58:23.301946 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [req-cfc54aaf-835c-4178-8338-9f468069d7b0 req-20b0567f-9ae7-45ef-a24a-c346af3b8131 service nova] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:23.302394 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [req-cfc54aaf-835c-4178-8338-9f468069d7b0 req-20b0567f-9ae7-45ef-a24a-c346af3b8131 service nova] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:23.325703 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.compute.server_external_events [req-cfc54aaf-835c-4178-8338-9f468069d7b0 req-20b0567f-9ae7-45ef-a24a-c346af3b8131 service nova] Creating event network-vif-plugged:0cdf2872-b922-4d87-8260-bb3c5b2a449b for instance acc03344-b5df-4277-82e4-c9b3228969ca on hv-cinder-78414 May 26 14:58:23.326475 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.compute.server_external_events [req-cfc54aaf-835c-4178-8338-9f468069d7b0 req-20b0567f-9ae7-45ef-a24a-c346af3b8131 service nova] Creating event network-vif-plugged:be847840-0dc2-4457-bb7b-594e083f4912 for instance aa145a33-41b1-4e39-9642-132aca11fcfe on hv-cinder-78414 May 26 14:58:23.333647 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [req-cfc54aaf-835c-4178-8338-9f468069d7b0 req-20b0567f-9ae7-45ef-a24a-c346af3b8131 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.055002 May 26 14:58:23.334496 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 50/104] 10.222.0.81 () {64 vars in 1318 bytes} [Wed May 26 14:58:23 2021] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:58:23.519714 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-9f2b1b89-59ad-4729-83d0-f83793212ed9 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:58:23.520926 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-9f2b1b89-59ad-4729-83d0-f83793212ed9 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 598b0e3f-8cf1-451a-80a8-ed7e5dd36984] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:58:23.529252 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-9f2b1b89-59ad-4729-83d0-f83793212ed9 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:23.529898 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-9f2b1b89-59ad-4729-83d0-f83793212ed9 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:23.530829 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-9f2b1b89-59ad-4729-83d0-f83793212ed9 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:23.535434 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-9f2b1b89-59ad-4729-83d0-f83793212ed9 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:23.617933 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-6757ae51-f7b5-4a07-a218-9c0de832643e tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:58:23.619176 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-6757ae51-f7b5-4a07-a218-9c0de832643e tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: a9d8f9a6-bd66-4caa-8662-4bb94655ae59] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:58:23.628192 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-6757ae51-f7b5-4a07-a218-9c0de832643e tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:23.628935 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-6757ae51-f7b5-4a07-a218-9c0de832643e tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:23.633671 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-6757ae51-f7b5-4a07-a218-9c0de832643e tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:23.633671 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-6757ae51-f7b5-4a07-a218-9c0de832643e tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:23.844690 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-9f2b1b89-59ad-4729-83d0-f83793212ed9 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:58:23.854125 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-9f2b1b89-59ad-4729-83d0-f83793212ed9 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:58:23.856359 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-9f2b1b89-59ad-4729-83d0-f83793212ed9 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:58:23.857728 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-9f2b1b89-59ad-4729-83d0-f83793212ed9 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984" status: 200 len: 1405 microversion: 2.20 time: 0.342841 May 26 14:58:23.861884 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 55/105] 10.222.0.81 () {60 vars in 1277 bytes} [Wed May 26 14:58:23 2021] GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984 => generated 1405 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:58:24.113627 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-6757ae51-f7b5-4a07-a218-9c0de832643e tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c2fb208b56d4d52b59ac09873f16180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e8cac36a174b2eb5a6e53fdf25b4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:58:24.129663 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-6757ae51-f7b5-4a07-a218-9c0de832643e tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59" status: 200 len: 1364 microversion: 2.1 time: 0.517783 May 26 14:58:24.133905 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 51/106] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:58:23 2021] GET /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59 => generated 1364 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:58:24.204265 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-398c6330-763b-40de-bdda-513898bc655d tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:58:24.204884 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-398c6330-763b-40de-bdda-513898bc655d tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] [instance: acc03344-b5df-4277-82e4-c9b3228969ca] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:58:24.212477 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-398c6330-763b-40de-bdda-513898bc655d tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:24.212939 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-398c6330-763b-40de-bdda-513898bc655d tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:24.213786 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-398c6330-763b-40de-bdda-513898bc655d tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:24.214231 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-398c6330-763b-40de-bdda-513898bc655d tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:24.529180 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-398c6330-763b-40de-bdda-513898bc655d tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b167942c895345b186a3eda5c82175b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad2ab2705ca479ab4aaafe7c80de162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:58:24.542397 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-398c6330-763b-40de-bdda-513898bc655d tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /compute/v2.1/servers/acc03344-b5df-4277-82e4-c9b3228969ca" status: 200 len: 1322 microversion: 2.1 time: 0.339978 May 26 14:58:24.552208 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 56/107] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:58:24 2021] GET /compute/v2.1/servers/acc03344-b5df-4277-82e4-c9b3228969ca => generated 1322 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:58:24.876506 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-2080b961-3161-424d-a0a7-cca40a855070 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:58:24.877856 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-2080b961-3161-424d-a0a7-cca40a855070 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 598b0e3f-8cf1-451a-80a8-ed7e5dd36984] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:58:24.885068 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-2080b961-3161-424d-a0a7-cca40a855070 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:24.885515 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-2080b961-3161-424d-a0a7-cca40a855070 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:24.886306 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-2080b961-3161-424d-a0a7-cca40a855070 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:24.886740 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-2080b961-3161-424d-a0a7-cca40a855070 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:25.134654 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-2080b961-3161-424d-a0a7-cca40a855070 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:58:25.144594 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-2080b961-3161-424d-a0a7-cca40a855070 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:58:25.146360 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-2080b961-3161-424d-a0a7-cca40a855070 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:58:25.147462 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-2080b961-3161-424d-a0a7-cca40a855070 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984" status: 200 len: 1405 microversion: 2.20 time: 0.274966 May 26 14:58:25.147998 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 52/108] 10.222.0.81 () {60 vars in 1277 bytes} [Wed May 26 14:58:24 2021] GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984 => generated 1405 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:58:25.148289 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-f405da1e-1627-410a-9f15-a59a74d4c203 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:58:25.148917 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-f405da1e-1627-410a-9f15-a59a74d4c203 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: a9d8f9a6-bd66-4caa-8662-4bb94655ae59] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:58:25.156963 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-f405da1e-1627-410a-9f15-a59a74d4c203 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:25.157422 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-f405da1e-1627-410a-9f15-a59a74d4c203 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:25.161758 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-f405da1e-1627-410a-9f15-a59a74d4c203 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:25.161758 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-f405da1e-1627-410a-9f15-a59a74d4c203 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:25.528685 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-f405da1e-1627-410a-9f15-a59a74d4c203 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c2fb208b56d4d52b59ac09873f16180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e8cac36a174b2eb5a6e53fdf25b4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:58:25.539398 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-f405da1e-1627-410a-9f15-a59a74d4c203 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59" status: 200 len: 1549 microversion: 2.1 time: 0.393270 May 26 14:58:25.545426 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 57/109] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:58:25 2021] GET /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59 => generated 1549 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 14:58:25.557818 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-6485363a-1675-4358-9b4e-83ac339bfc42 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:58:25.558325 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-6485363a-1675-4358-9b4e-83ac339bfc42 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: a9d8f9a6-bd66-4caa-8662-4bb94655ae59] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:58:25.558851 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-bcef69a3-1bdc-4ccc-8a17-dd0ed3b39f74 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:58:25.559483 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-bcef69a3-1bdc-4ccc-8a17-dd0ed3b39f74 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] [instance: acc03344-b5df-4277-82e4-c9b3228969ca] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:58:25.566902 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-6485363a-1675-4358-9b4e-83ac339bfc42 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:25.567362 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-6485363a-1675-4358-9b4e-83ac339bfc42 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:25.567616 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-bcef69a3-1bdc-4ccc-8a17-dd0ed3b39f74 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:25.568078 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-bcef69a3-1bdc-4ccc-8a17-dd0ed3b39f74 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:25.568179 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-6485363a-1675-4358-9b4e-83ac339bfc42 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:25.568587 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-6485363a-1675-4358-9b4e-83ac339bfc42 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:25.568867 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-bcef69a3-1bdc-4ccc-8a17-dd0ed3b39f74 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:25.569309 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-bcef69a3-1bdc-4ccc-8a17-dd0ed3b39f74 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:25.759900 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-6485363a-1675-4358-9b4e-83ac339bfc42 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.205803 May 26 14:58:25.761042 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 53/110] 10.222.0.81 () {58 vars in 1275 bytes} [Wed May 26 14:58:25 2021] GET /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59/os-interface => generated 284 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:58:26.057430 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-bcef69a3-1bdc-4ccc-8a17-dd0ed3b39f74 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b167942c895345b186a3eda5c82175b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad2ab2705ca479ab4aaafe7c80de162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:58:26.069883 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-bcef69a3-1bdc-4ccc-8a17-dd0ed3b39f74 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /compute/v2.1/servers/acc03344-b5df-4277-82e4-c9b3228969ca" status: 200 len: 1516 microversion: 2.1 time: 0.514346 May 26 14:58:26.071382 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 58/111] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:58:25 2021] GET /compute/v2.1/servers/acc03344-b5df-4277-82e4-c9b3228969ca => generated 1516 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 14:58:26.088124 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-eeca6dcc-3e79-48f0-a39b-e0947a470545 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:58:26.089295 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-eeca6dcc-3e79-48f0-a39b-e0947a470545 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] [instance: acc03344-b5df-4277-82e4-c9b3228969ca] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:58:26.098888 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-eeca6dcc-3e79-48f0-a39b-e0947a470545 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:26.103692 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-eeca6dcc-3e79-48f0-a39b-e0947a470545 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:26.104546 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-eeca6dcc-3e79-48f0-a39b-e0947a470545 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:26.104993 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-eeca6dcc-3e79-48f0-a39b-e0947a470545 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:26.165279 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-3ed0ff6e-e4fe-4133-9dbb-9e7b6a1d6a2b tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:58:26.165918 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-3ed0ff6e-e4fe-4133-9dbb-9e7b6a1d6a2b tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 598b0e3f-8cf1-451a-80a8-ed7e5dd36984] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:58:26.188252 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-3ed0ff6e-e4fe-4133-9dbb-9e7b6a1d6a2b tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:26.188913 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-3ed0ff6e-e4fe-4133-9dbb-9e7b6a1d6a2b tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:26.189133 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.objects.instance [None req-eeca6dcc-3e79-48f0-a39b-e0947a470545 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lazy-loading 'flavor' on Instance uuid acc03344-b5df-4277-82e4-c9b3228969ca {{(pid=118514) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 26 14:58:26.190484 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-3ed0ff6e-e4fe-4133-9dbb-9e7b6a1d6a2b tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:26.190991 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-3ed0ff6e-e4fe-4133-9dbb-9e7b6a1d6a2b tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:26.607432 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-eeca6dcc-3e79-48f0-a39b-e0947a470545 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "POST /compute/v2.1/servers/acc03344-b5df-4277-82e4-c9b3228969ca/action" status: 200 len: 32 microversion: 2.1 time: 0.520458 May 26 14:58:26.609991 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 54/112] 10.222.0.81 () {60 vars in 1278 bytes} [Wed May 26 14:58:26 2021] POST /compute/v2.1/servers/acc03344-b5df-4277-82e4-c9b3228969ca/action => generated 32 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 26 14:58:26.634487 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-4d43fad7-5f89-4125-a2ba-ec162ea9b6fe tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:58:26.635237 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-4d43fad7-5f89-4125-a2ba-ec162ea9b6fe tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] [instance: acc03344-b5df-4277-82e4-c9b3228969ca] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:58:26.756079 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-4d43fad7-5f89-4125-a2ba-ec162ea9b6fe tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:26.756079 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-4d43fad7-5f89-4125-a2ba-ec162ea9b6fe tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:26.756079 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-4d43fad7-5f89-4125-a2ba-ec162ea9b6fe tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:26.756079 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-4d43fad7-5f89-4125-a2ba-ec162ea9b6fe tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:26.881131 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-3ed0ff6e-e4fe-4133-9dbb-9e7b6a1d6a2b tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:58:26.881131 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-3ed0ff6e-e4fe-4133-9dbb-9e7b6a1d6a2b tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:58:26.881831 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-3ed0ff6e-e4fe-4133-9dbb-9e7b6a1d6a2b tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:58:26.881831 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-3ed0ff6e-e4fe-4133-9dbb-9e7b6a1d6a2b tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984" status: 200 len: 1405 microversion: 2.20 time: 0.697778 May 26 14:58:26.881831 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 59/113] 10.222.0.81 () {60 vars in 1277 bytes} [Wed May 26 14:58:26 2021] GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984 => generated 1405 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 14:58:27.022666 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-4d43fad7-5f89-4125-a2ba-ec162ea9b6fe tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b167942c895345b186a3eda5c82175b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad2ab2705ca479ab4aaafe7c80de162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:58:27.022666 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-4d43fad7-5f89-4125-a2ba-ec162ea9b6fe tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /compute/v2.1/servers/acc03344-b5df-4277-82e4-c9b3228969ca" status: 200 len: 1522 microversion: 2.1 time: 0.392205 May 26 14:58:27.022666 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 55/114] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:58:26 2021] GET /compute/v2.1/servers/acc03344-b5df-4277-82e4-c9b3228969ca => generated 1522 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:58:27.893877 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-4a48c949-a7f4-4344-aed4-5758769c72c4 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:58:27.893877 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-4a48c949-a7f4-4344-aed4-5758769c72c4 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 598b0e3f-8cf1-451a-80a8-ed7e5dd36984] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:58:27.919799 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-4a48c949-a7f4-4344-aed4-5758769c72c4 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:27.920270 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-4a48c949-a7f4-4344-aed4-5758769c72c4 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:27.921066 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-4a48c949-a7f4-4344-aed4-5758769c72c4 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:27.921727 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-4a48c949-a7f4-4344-aed4-5758769c72c4 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:28.040844 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-5b7a5535-6d1d-4936-8492-172f4d2b7733 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:58:28.041508 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-5b7a5535-6d1d-4936-8492-172f4d2b7733 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] [instance: acc03344-b5df-4277-82e4-c9b3228969ca] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:58:28.048979 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-5b7a5535-6d1d-4936-8492-172f4d2b7733 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:28.049439 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-5b7a5535-6d1d-4936-8492-172f4d2b7733 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:28.050279 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-5b7a5535-6d1d-4936-8492-172f4d2b7733 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:28.050721 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-5b7a5535-6d1d-4936-8492-172f4d2b7733 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:28.278273 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-5b7a5535-6d1d-4936-8492-172f4d2b7733 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b167942c895345b186a3eda5c82175b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad2ab2705ca479ab4aaafe7c80de162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:58:28.287315 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-5b7a5535-6d1d-4936-8492-172f4d2b7733 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /compute/v2.1/servers/acc03344-b5df-4277-82e4-c9b3228969ca" status: 200 len: 1522 microversion: 2.1 time: 0.250405 May 26 14:58:28.287896 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 56/115] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:58:28 2021] GET /compute/v2.1/servers/acc03344-b5df-4277-82e4-c9b3228969ca => generated 1522 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 14:58:28.374587 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-4a48c949-a7f4-4344-aed4-5758769c72c4 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:58:28.388091 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-4a48c949-a7f4-4344-aed4-5758769c72c4 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:58:28.390562 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-4a48c949-a7f4-4344-aed4-5758769c72c4 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:58:28.393070 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-4a48c949-a7f4-4344-aed4-5758769c72c4 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984" status: 200 len: 1405 microversion: 2.20 time: 0.503890 May 26 14:58:28.394139 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 60/116] 10.222.0.81 () {60 vars in 1277 bytes} [Wed May 26 14:58:27 2021] GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984 => generated 1405 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:58:28.514451 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [req-e0b6504a-7c67-4a32-8de8-400d6d91ceb5 req-b72e45cf-d385-465a-81fa-b91bef73f9a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "598b0e3f-8cf1-451a-80a8-ed7e5dd36984", "name": "network-vif-plugged", "status": "completed", "tag": "e948d481-711f-45b8-8deb-08b7658709e7"}]} {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:58:28.516359 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 14:58:28.516359 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: warnings.warn(msg) May 26 14:58:28.527194 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [req-e0b6504a-7c67-4a32-8de8-400d6d91ceb5 req-b72e45cf-d385-465a-81fa-b91bef73f9a9 service nova] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:28.528018 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [req-e0b6504a-7c67-4a32-8de8-400d6d91ceb5 req-b72e45cf-d385-465a-81fa-b91bef73f9a9 service nova] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:28.545364 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.compute.server_external_events [req-e0b6504a-7c67-4a32-8de8-400d6d91ceb5 req-b72e45cf-d385-465a-81fa-b91bef73f9a9 service nova] Creating event network-vif-plugged:e948d481-711f-45b8-8deb-08b7658709e7 for instance 598b0e3f-8cf1-451a-80a8-ed7e5dd36984 on hv-cinder-78414 May 26 14:58:28.550131 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [req-e0b6504a-7c67-4a32-8de8-400d6d91ceb5 req-b72e45cf-d385-465a-81fa-b91bef73f9a9 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039552 May 26 14:58:28.550964 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 57/117] 10.222.0.81 () {64 vars in 1318 bytes} [Wed May 26 14:58:28 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:58:28.735400 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-93b13523-a5f9-47ac-889c-0d8ab70e0dec tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:58:28.736517 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-93b13523-a5f9-47ac-889c-0d8ab70e0dec tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: a9d8f9a6-bd66-4caa-8662-4bb94655ae59] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:58:28.747519 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-93b13523-a5f9-47ac-889c-0d8ab70e0dec tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:28.747979 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-93b13523-a5f9-47ac-889c-0d8ab70e0dec tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:28.748783 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-93b13523-a5f9-47ac-889c-0d8ab70e0dec tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:28.749237 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-93b13523-a5f9-47ac-889c-0d8ab70e0dec tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:28.754616 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [req-cf35c36d-e3f9-4477-946d-47869237dac8 req-18f644f5-2716-4a68-9443-8f2fb43a8016 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9d8f9a6-bd66-4caa-8662-4bb94655ae59", "tag": "5b77d4a0-1161-49af-829e-9c8b577a215a"}]} {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:58:28.756936 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 14:58:28.756936 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: warnings.warn(msg) May 26 14:58:28.770732 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [req-cf35c36d-e3f9-4477-946d-47869237dac8 req-18f644f5-2716-4a68-9443-8f2fb43a8016 service nova] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:28.776105 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [req-cf35c36d-e3f9-4477-946d-47869237dac8 req-18f644f5-2716-4a68-9443-8f2fb43a8016 service nova] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:28.792549 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.compute.server_external_events [req-cf35c36d-e3f9-4477-946d-47869237dac8 req-18f644f5-2716-4a68-9443-8f2fb43a8016 service nova] Creating event network-changed:5b77d4a0-1161-49af-829e-9c8b577a215a for instance a9d8f9a6-bd66-4caa-8662-4bb94655ae59 on hv-cinder-78414 May 26 14:58:28.800750 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [req-cf35c36d-e3f9-4477-946d-47869237dac8 req-18f644f5-2716-4a68-9443-8f2fb43a8016 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052688 May 26 14:58:28.809226 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 58/118] 10.222.0.81 () {64 vars in 1318 bytes} [Wed May 26 14:58:28 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:58:28.908034 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-93b13523-a5f9-47ac-889c-0d8ab70e0dec tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "POST /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59/action" status: 200 len: 14 microversion: 2.1 time: 0.176370 May 26 14:58:28.911508 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 61/119] 10.222.0.81 () {60 vars in 1278 bytes} [Wed May 26 14:58:28 2021] POST /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59/action => generated 14 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 26 14:58:29.305320 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-70849019-c4c9-49e9-a13e-8e90a07aece1 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:58:29.310325 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-70849019-c4c9-49e9-a13e-8e90a07aece1 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] [instance: acc03344-b5df-4277-82e4-c9b3228969ca] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:58:29.313949 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-70849019-c4c9-49e9-a13e-8e90a07aece1 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:29.314465 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-70849019-c4c9-49e9-a13e-8e90a07aece1 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:29.315267 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-70849019-c4c9-49e9-a13e-8e90a07aece1 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:29.315708 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-70849019-c4c9-49e9-a13e-8e90a07aece1 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:29.414226 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-b22f5704-b507-4801-9a1a-b8ff83274138 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:58:29.414926 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-b22f5704-b507-4801-9a1a-b8ff83274138 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 598b0e3f-8cf1-451a-80a8-ed7e5dd36984] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:58:29.430470 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-b22f5704-b507-4801-9a1a-b8ff83274138 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:29.433589 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-b22f5704-b507-4801-9a1a-b8ff83274138 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:29.433589 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-b22f5704-b507-4801-9a1a-b8ff83274138 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:29.433589 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-b22f5704-b507-4801-9a1a-b8ff83274138 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:29.640651 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-70849019-c4c9-49e9-a13e-8e90a07aece1 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b167942c895345b186a3eda5c82175b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad2ab2705ca479ab4aaafe7c80de162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:58:29.657696 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-70849019-c4c9-49e9-a13e-8e90a07aece1 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /compute/v2.1/servers/acc03344-b5df-4277-82e4-c9b3228969ca" status: 200 len: 1522 microversion: 2.1 time: 0.357046 May 26 14:58:29.659223 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 59/120] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:58:29 2021] GET /compute/v2.1/servers/acc03344-b5df-4277-82e4-c9b3228969ca => generated 1522 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:58:29.687758 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-b22f5704-b507-4801-9a1a-b8ff83274138 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:58:29.701207 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-b22f5704-b507-4801-9a1a-b8ff83274138 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:58:29.702984 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-b22f5704-b507-4801-9a1a-b8ff83274138 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:58:29.704294 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-b22f5704-b507-4801-9a1a-b8ff83274138 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984" status: 200 len: 1405 microversion: 2.20 time: 0.296551 May 26 14:58:29.727181 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 62/121] 10.222.0.81 () {60 vars in 1277 bytes} [Wed May 26 14:58:29 2021] GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984 => generated 1405 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:58:29.918713 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-8ea92cb8-8a70-4fc1-a966-daac94cd8fc6 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:58:29.920146 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-8ea92cb8-8a70-4fc1-a966-daac94cd8fc6 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: a9d8f9a6-bd66-4caa-8662-4bb94655ae59] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:58:29.932966 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-8ea92cb8-8a70-4fc1-a966-daac94cd8fc6 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:29.932966 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-8ea92cb8-8a70-4fc1-a966-daac94cd8fc6 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:29.932966 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-8ea92cb8-8a70-4fc1-a966-daac94cd8fc6 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:29.932966 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-8ea92cb8-8a70-4fc1-a966-daac94cd8fc6 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:30.083609 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-8ea92cb8-8a70-4fc1-a966-daac94cd8fc6 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "POST /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59/action" status: 200 len: 14 microversion: 2.1 time: 0.168179 May 26 14:58:30.084879 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 60/122] 10.222.0.81 () {60 vars in 1278 bytes} [Wed May 26 14:58:29 2021] POST /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59/action => generated 14 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 26 14:58:30.528687 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-c4183450-3f28-4a21-95e0-1e552d083f4a tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:58:30.529215 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-c4183450-3f28-4a21-95e0-1e552d083f4a tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] [instance: 2b37b708-5d64-4e1f-9e17-32f528641ca5] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:58:30.549450 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-c4183450-3f28-4a21-95e0-1e552d083f4a tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:30.549928 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-c4183450-3f28-4a21-95e0-1e552d083f4a tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:30.550713 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-c4183450-3f28-4a21-95e0-1e552d083f4a tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:30.551310 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-c4183450-3f28-4a21-95e0-1e552d083f4a tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:30.661702 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-c4183450-3f28-4a21-95e0-1e552d083f4a tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] [instance: 2b37b708-5d64-4e1f-9e17-32f528641ca5] Going to try to terminate instance {{(pid=118513) delete /opt/stack/nova/nova/compute/api.py:2539}} May 26 14:58:30.675232 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-137b9269-fb6d-4800-b46b-416e24b1c22f tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:58:30.676172 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-137b9269-fb6d-4800-b46b-416e24b1c22f tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] [instance: acc03344-b5df-4277-82e4-c9b3228969ca] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:58:30.689849 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-137b9269-fb6d-4800-b46b-416e24b1c22f tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:30.695396 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-137b9269-fb6d-4800-b46b-416e24b1c22f tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:30.695396 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-137b9269-fb6d-4800-b46b-416e24b1c22f tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:30.695396 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-137b9269-fb6d-4800-b46b-416e24b1c22f tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:30.967844 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-137b9269-fb6d-4800-b46b-416e24b1c22f tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b167942c895345b186a3eda5c82175b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad2ab2705ca479ab4aaafe7c80de162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:58:30.976291 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-137b9269-fb6d-4800-b46b-416e24b1c22f tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /compute/v2.1/servers/acc03344-b5df-4277-82e4-c9b3228969ca" status: 200 len: 1522 microversion: 2.1 time: 0.305101 May 26 14:58:30.976858 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 61/123] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:58:30 2021] GET /compute/v2.1/servers/acc03344-b5df-4277-82e4-c9b3228969ca => generated 1522 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:58:30.981156 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-3b3133cb-34d6-4044-bac7-50939636a64c tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:58:30.983650 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-3b3133cb-34d6-4044-bac7-50939636a64c tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 598b0e3f-8cf1-451a-80a8-ed7e5dd36984] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:58:30.989245 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-3b3133cb-34d6-4044-bac7-50939636a64c tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:30.989812 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-3b3133cb-34d6-4044-bac7-50939636a64c tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:30.990728 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-3b3133cb-34d6-4044-bac7-50939636a64c tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:30.991260 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-3b3133cb-34d6-4044-bac7-50939636a64c tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:31.161904 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-c4183450-3f28-4a21-95e0-1e552d083f4a tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] 10.222.0.81 "DELETE /compute/v2.1/servers/2b37b708-5d64-4e1f-9e17-32f528641ca5" status: 204 len: 0 microversion: 2.1 time: 0.636713 May 26 14:58:31.162961 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 63/124] 10.222.0.81 () {58 vars in 1239 bytes} [Wed May 26 14:58:30 2021] DELETE /compute/v2.1/servers/2b37b708-5d64-4e1f-9e17-32f528641ca5 => generated 0 bytes in 639 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 14:58:31.169180 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-d7f22993-8548-4551-b56b-8633b7a3a3c8 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:58:31.170609 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-d7f22993-8548-4551-b56b-8633b7a3a3c8 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: a9d8f9a6-bd66-4caa-8662-4bb94655ae59] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:58:31.188906 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-d7f22993-8548-4551-b56b-8633b7a3a3c8 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:31.190456 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-d7f22993-8548-4551-b56b-8633b7a3a3c8 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:31.197068 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-d7f22993-8548-4551-b56b-8633b7a3a3c8 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:31.198130 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-d7f22993-8548-4551-b56b-8633b7a3a3c8 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:31.254208 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-3b3133cb-34d6-4044-bac7-50939636a64c tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:58:31.263347 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-3b3133cb-34d6-4044-bac7-50939636a64c tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:58:31.264870 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-3b3133cb-34d6-4044-bac7-50939636a64c tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:58:31.266051 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-3b3133cb-34d6-4044-bac7-50939636a64c tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984" status: 200 len: 1598 microversion: 2.20 time: 0.288250 May 26 14:58:31.266613 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 62/125] 10.222.0.81 () {60 vars in 1277 bytes} [Wed May 26 14:58:30 2021] GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984 => generated 1598 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:58:31.272896 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-c0b8896f-3418-426c-ad26-ad388ff4f53b tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:58:31.273725 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-c0b8896f-3418-426c-ad26-ad388ff4f53b tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] [instance: 2b37b708-5d64-4e1f-9e17-32f528641ca5] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:58:31.281354 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-c0b8896f-3418-426c-ad26-ad388ff4f53b tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:31.282018 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-c0b8896f-3418-426c-ad26-ad388ff4f53b tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:31.283117 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-c0b8896f-3418-426c-ad26-ad388ff4f53b tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:31.284137 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-c0b8896f-3418-426c-ad26-ad388ff4f53b tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:31.325411 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-d7f22993-8548-4551-b56b-8633b7a3a3c8 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "POST /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59/action" status: 200 len: 14 microversion: 2.1 time: 0.160759 May 26 14:58:31.326074 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 64/126] 10.222.0.81 () {60 vars in 1278 bytes} [Wed May 26 14:58:31 2021] POST /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59/action => generated 14 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 26 14:58:31.332080 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-d11a8951-fd95-4a96-807b-b35ac2ef693f tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:58:31.332671 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-d11a8951-fd95-4a96-807b-b35ac2ef693f tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 598b0e3f-8cf1-451a-80a8-ed7e5dd36984] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:58:31.340245 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-d11a8951-fd95-4a96-807b-b35ac2ef693f tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:31.340708 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-d11a8951-fd95-4a96-807b-b35ac2ef693f tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:31.341467 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-d11a8951-fd95-4a96-807b-b35ac2ef693f tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:31.341929 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-d11a8951-fd95-4a96-807b-b35ac2ef693f tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:31.508219 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-d11a8951-fd95-4a96-807b-b35ac2ef693f tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.180844 May 26 14:58:31.508895 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 65/127] 10.222.0.81 () {60 vars in 1316 bytes} [Wed May 26 14:58:31 2021] GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984/os-interface => generated 285 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 14:58:31.529638 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-c0b8896f-3418-426c-ad26-ad388ff4f53b tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d6fb430257a489c8b8a1890ecb5ea93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f665681e524725b9abb121531f47a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:58:31.545226 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-c0b8896f-3418-426c-ad26-ad388ff4f53b tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] 10.222.0.81 "GET /compute/v2.1/servers/2b37b708-5d64-4e1f-9e17-32f528641ca5" status: 200 len: 1551 microversion: 2.1 time: 0.277406 May 26 14:58:31.546041 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 63/128] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:58:31 2021] GET /compute/v2.1/servers/2b37b708-5d64-4e1f-9e17-32f528641ca5 => generated 1551 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:58:31.994586 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-5987eb58-812f-4150-8cf8-2d176790fc71 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:58:31.995409 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-5987eb58-812f-4150-8cf8-2d176790fc71 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] [instance: acc03344-b5df-4277-82e4-c9b3228969ca] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:58:32.003780 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-5987eb58-812f-4150-8cf8-2d176790fc71 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:32.004516 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-5987eb58-812f-4150-8cf8-2d176790fc71 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:32.005387 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-5987eb58-812f-4150-8cf8-2d176790fc71 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:32.005808 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-5987eb58-812f-4150-8cf8-2d176790fc71 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:32.337341 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-162e00c1-9a6a-491f-b6c3-a53216f9e914 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:58:32.338390 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-162e00c1-9a6a-491f-b6c3-a53216f9e914 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: a9d8f9a6-bd66-4caa-8662-4bb94655ae59] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:58:32.344714 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-5987eb58-812f-4150-8cf8-2d176790fc71 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b167942c895345b186a3eda5c82175b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad2ab2705ca479ab4aaafe7c80de162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:58:32.350135 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-162e00c1-9a6a-491f-b6c3-a53216f9e914 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:32.350946 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-162e00c1-9a6a-491f-b6c3-a53216f9e914 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:32.351907 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-162e00c1-9a6a-491f-b6c3-a53216f9e914 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:32.352495 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-162e00c1-9a6a-491f-b6c3-a53216f9e914 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:32.357701 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-5987eb58-812f-4150-8cf8-2d176790fc71 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /compute/v2.1/servers/acc03344-b5df-4277-82e4-c9b3228969ca" status: 200 len: 1522 microversion: 2.1 time: 0.367661 May 26 14:58:32.367117 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 66/129] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:58:31 2021] GET /compute/v2.1/servers/acc03344-b5df-4277-82e4-c9b3228969ca => generated 1522 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:58:32.468040 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-162e00c1-9a6a-491f-b6c3-a53216f9e914 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "POST /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59/action" status: 200 len: 14 microversion: 2.1 time: 0.134209 May 26 14:58:32.468356 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 64/130] 10.222.0.81 () {60 vars in 1278 bytes} [Wed May 26 14:58:32 2021] POST /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59/action => generated 14 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 26 14:58:32.563192 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-916f7e70-041a-4b46-89c0-b177ba75b9f1 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:58:32.564769 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-916f7e70-041a-4b46-89c0-b177ba75b9f1 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] [instance: 2b37b708-5d64-4e1f-9e17-32f528641ca5] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:58:32.574348 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-916f7e70-041a-4b46-89c0-b177ba75b9f1 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:32.575172 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-916f7e70-041a-4b46-89c0-b177ba75b9f1 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:32.576378 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-916f7e70-041a-4b46-89c0-b177ba75b9f1 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:32.577107 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-916f7e70-041a-4b46-89c0-b177ba75b9f1 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:33.222926 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-916f7e70-041a-4b46-89c0-b177ba75b9f1 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d6fb430257a489c8b8a1890ecb5ea93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f665681e524725b9abb121531f47a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:58:33.233303 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-916f7e70-041a-4b46-89c0-b177ba75b9f1 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] 10.222.0.81 "GET /compute/v2.1/servers/2b37b708-5d64-4e1f-9e17-32f528641ca5" status: 200 len: 1551 microversion: 2.1 time: 0.674700 May 26 14:58:33.234009 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 67/131] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:58:32 2021] GET /compute/v2.1/servers/2b37b708-5d64-4e1f-9e17-32f528641ca5 => generated 1551 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:58:33.379640 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-d7e452ee-e1c6-4d54-bf7f-27e8fa0ba144 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:58:33.380398 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-d7e452ee-e1c6-4d54-bf7f-27e8fa0ba144 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] [instance: acc03344-b5df-4277-82e4-c9b3228969ca] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:58:33.389013 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-d7e452ee-e1c6-4d54-bf7f-27e8fa0ba144 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:33.389472 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-d7e452ee-e1c6-4d54-bf7f-27e8fa0ba144 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:33.390877 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-d7e452ee-e1c6-4d54-bf7f-27e8fa0ba144 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:33.401935 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-d7e452ee-e1c6-4d54-bf7f-27e8fa0ba144 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:33.482208 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-5fb256de-0d90-4f22-a475-a098c84588d2 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:58:33.483696 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-5fb256de-0d90-4f22-a475-a098c84588d2 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: a9d8f9a6-bd66-4caa-8662-4bb94655ae59] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:58:33.494237 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-5fb256de-0d90-4f22-a475-a098c84588d2 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:33.495081 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-5fb256de-0d90-4f22-a475-a098c84588d2 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:33.497288 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-5fb256de-0d90-4f22-a475-a098c84588d2 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:33.498223 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-5fb256de-0d90-4f22-a475-a098c84588d2 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:33.625798 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-5fb256de-0d90-4f22-a475-a098c84588d2 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "POST /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59/action" status: 200 len: 14 microversion: 2.1 time: 0.147577 May 26 14:58:33.627850 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 68/132] 10.222.0.81 () {60 vars in 1278 bytes} [Wed May 26 14:58:33 2021] POST /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59/action => generated 14 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 26 14:58:33.775070 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-937e38e3-ca9d-401e-9b01-9adce407587f tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:58:33.776227 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-937e38e3-ca9d-401e-9b01-9adce407587f tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 598b0e3f-8cf1-451a-80a8-ed7e5dd36984] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:58:33.787636 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-937e38e3-ca9d-401e-9b01-9adce407587f tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:33.788665 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-937e38e3-ca9d-401e-9b01-9adce407587f tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:33.790463 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-937e38e3-ca9d-401e-9b01-9adce407587f tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:33.791478 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-937e38e3-ca9d-401e-9b01-9adce407587f tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:33.923868 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-937e38e3-ca9d-401e-9b01-9adce407587f tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "POST /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984/action" status: 200 len: 14 microversion: 2.20 time: 0.153318 May 26 14:58:33.933679 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 69/133] 10.222.0.81 () {62 vars in 1319 bytes} [Wed May 26 14:58:33 2021] POST /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984/action => generated 14 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:58:33.941052 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [req-c69952ec-54ab-40e5-9443-fd0e77362b01 req-7f6d0760-4614-48da-a445-0d0355a6870e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "598b0e3f-8cf1-451a-80a8-ed7e5dd36984", "tag": "e948d481-711f-45b8-8deb-08b7658709e7"}]} {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:58:33.942823 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 14:58:33.942823 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: warnings.warn(msg) May 26 14:58:33.956800 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [req-c69952ec-54ab-40e5-9443-fd0e77362b01 req-7f6d0760-4614-48da-a445-0d0355a6870e service nova] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:33.957420 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [req-c69952ec-54ab-40e5-9443-fd0e77362b01 req-7f6d0760-4614-48da-a445-0d0355a6870e service nova] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:33.979446 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.compute.server_external_events [req-c69952ec-54ab-40e5-9443-fd0e77362b01 req-7f6d0760-4614-48da-a445-0d0355a6870e service nova] Creating event network-changed:e948d481-711f-45b8-8deb-08b7658709e7 for instance 598b0e3f-8cf1-451a-80a8-ed7e5dd36984 on hv-cinder-78414 May 26 14:58:33.981472 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [req-c69952ec-54ab-40e5-9443-fd0e77362b01 req-7f6d0760-4614-48da-a445-0d0355a6870e service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046037 May 26 14:58:33.984596 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 70/134] 10.222.0.81 () {64 vars in 1318 bytes} [Wed May 26 14:58:33 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:58:34.021628 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-d7e452ee-e1c6-4d54-bf7f-27e8fa0ba144 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b167942c895345b186a3eda5c82175b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad2ab2705ca479ab4aaafe7c80de162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:58:34.034537 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-d7e452ee-e1c6-4d54-bf7f-27e8fa0ba144 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /compute/v2.1/servers/acc03344-b5df-4277-82e4-c9b3228969ca" status: 200 len: 1522 microversion: 2.1 time: 0.662444 May 26 14:58:34.047639 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 65/135] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:58:33 2021] GET /compute/v2.1/servers/acc03344-b5df-4277-82e4-c9b3228969ca => generated 1522 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:58:34.253070 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-9c16a9b5-29e9-4742-bf78-d6f7bcc1b2e0 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:58:34.257150 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-9c16a9b5-29e9-4742-bf78-d6f7bcc1b2e0 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] [instance: 2b37b708-5d64-4e1f-9e17-32f528641ca5] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:58:34.268533 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-9c16a9b5-29e9-4742-bf78-d6f7bcc1b2e0 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:34.269298 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-9c16a9b5-29e9-4742-bf78-d6f7bcc1b2e0 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:34.270461 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-9c16a9b5-29e9-4742-bf78-d6f7bcc1b2e0 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:34.272183 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-9c16a9b5-29e9-4742-bf78-d6f7bcc1b2e0 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:34.639544 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-bdb94742-4fe1-4746-a24f-2460d6028a20 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:58:34.640803 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-bdb94742-4fe1-4746-a24f-2460d6028a20 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: a9d8f9a6-bd66-4caa-8662-4bb94655ae59] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:58:34.659225 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-bdb94742-4fe1-4746-a24f-2460d6028a20 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:34.659679 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-bdb94742-4fe1-4746-a24f-2460d6028a20 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:34.662163 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-bdb94742-4fe1-4746-a24f-2460d6028a20 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:34.662163 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-bdb94742-4fe1-4746-a24f-2460d6028a20 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:34.790580 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-bdb94742-4fe1-4746-a24f-2460d6028a20 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "POST /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59/action" status: 200 len: 14 microversion: 2.1 time: 0.154710 May 26 14:58:34.794868 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-9c16a9b5-29e9-4742-bf78-d6f7bcc1b2e0 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d6fb430257a489c8b8a1890ecb5ea93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f665681e524725b9abb121531f47a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:58:34.795357 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 66/136] 10.222.0.81 () {60 vars in 1278 bytes} [Wed May 26 14:58:34 2021] POST /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59/action => generated 14 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 26 14:58:34.811954 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-9c16a9b5-29e9-4742-bf78-d6f7bcc1b2e0 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] 10.222.0.81 "GET /compute/v2.1/servers/2b37b708-5d64-4e1f-9e17-32f528641ca5" status: 200 len: 1551 microversion: 2.1 time: 0.560937 May 26 14:58:34.812601 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 71/137] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:58:34 2021] GET /compute/v2.1/servers/2b37b708-5d64-4e1f-9e17-32f528641ca5 => generated 1551 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:58:34.863459 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [req-031cc866-b490-498c-97b6-45200ab4573a req-ecc6398f-cb0c-404d-be2e-6ada7efc02ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b37b708-5d64-4e1f-9e17-32f528641ca5", "name": "network-vif-deleted", "tag": "24b593cd-0651-4f0f-aa78-c431b4dbb3f1"}]} {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:58:34.865125 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 14:58:34.865125 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: warnings.warn(msg) May 26 14:58:34.886208 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [req-031cc866-b490-498c-97b6-45200ab4573a req-ecc6398f-cb0c-404d-be2e-6ada7efc02ca service nova] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:34.892358 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [req-031cc866-b490-498c-97b6-45200ab4573a req-ecc6398f-cb0c-404d-be2e-6ada7efc02ca service nova] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:34.938259 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-018f9a61-1757-4b33-b93d-d32dc2502857 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:58:34.940546 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-018f9a61-1757-4b33-b93d-d32dc2502857 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 598b0e3f-8cf1-451a-80a8-ed7e5dd36984] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:58:34.944399 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.compute.server_external_events [req-031cc866-b490-498c-97b6-45200ab4573a req-ecc6398f-cb0c-404d-be2e-6ada7efc02ca service nova] Creating event network-vif-deleted:24b593cd-0651-4f0f-aa78-c431b4dbb3f1 for instance 2b37b708-5d64-4e1f-9e17-32f528641ca5 on hv-cinder-78414 May 26 14:58:34.960222 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [req-031cc866-b490-498c-97b6-45200ab4573a req-ecc6398f-cb0c-404d-be2e-6ada7efc02ca service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102778 May 26 14:58:34.961093 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 67/138] 10.222.0.81 () {64 vars in 1318 bytes} [Wed May 26 14:58:34 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:58:34.966116 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-018f9a61-1757-4b33-b93d-d32dc2502857 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:34.967561 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-018f9a61-1757-4b33-b93d-d32dc2502857 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:34.968899 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-018f9a61-1757-4b33-b93d-d32dc2502857 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:34.969637 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-018f9a61-1757-4b33-b93d-d32dc2502857 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:35.051528 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-73c7d60e-db8a-477e-8dba-18469fdc5809 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:58:35.052241 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-73c7d60e-db8a-477e-8dba-18469fdc5809 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] [instance: acc03344-b5df-4277-82e4-c9b3228969ca] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:58:35.070354 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-73c7d60e-db8a-477e-8dba-18469fdc5809 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:35.072132 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-73c7d60e-db8a-477e-8dba-18469fdc5809 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:35.073171 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-73c7d60e-db8a-477e-8dba-18469fdc5809 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:35.073929 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-73c7d60e-db8a-477e-8dba-18469fdc5809 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:35.135207 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-018f9a61-1757-4b33-b93d-d32dc2502857 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "POST /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984/action" status: 200 len: 14 microversion: 2.20 time: 0.202113 May 26 14:58:35.136648 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 72/139] 10.222.0.81 () {62 vars in 1319 bytes} [Wed May 26 14:58:34 2021] POST /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984/action => generated 14 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:58:35.452593 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-73c7d60e-db8a-477e-8dba-18469fdc5809 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b167942c895345b186a3eda5c82175b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad2ab2705ca479ab4aaafe7c80de162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:58:35.484240 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-73c7d60e-db8a-477e-8dba-18469fdc5809 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /compute/v2.1/servers/acc03344-b5df-4277-82e4-c9b3228969ca" status: 200 len: 1522 microversion: 2.1 time: 0.426890 May 26 14:58:35.484240 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 68/140] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:58:35 2021] GET /compute/v2.1/servers/acc03344-b5df-4277-82e4-c9b3228969ca => generated 1522 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 14:58:35.803187 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-c41962c1-2f6e-44e3-b29e-a18055d11f6b tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:58:35.804774 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-c41962c1-2f6e-44e3-b29e-a18055d11f6b tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: a9d8f9a6-bd66-4caa-8662-4bb94655ae59] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:58:35.819696 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-c41962c1-2f6e-44e3-b29e-a18055d11f6b tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:35.820125 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-c41962c1-2f6e-44e3-b29e-a18055d11f6b tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:35.820927 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-c41962c1-2f6e-44e3-b29e-a18055d11f6b tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:35.821374 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-c41962c1-2f6e-44e3-b29e-a18055d11f6b tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:35.828608 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-ee502f1d-6c12-48dd-8d74-0386ab680f66 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:58:35.829241 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-ee502f1d-6c12-48dd-8d74-0386ab680f66 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] [instance: 2b37b708-5d64-4e1f-9e17-32f528641ca5] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:58:35.847190 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-ee502f1d-6c12-48dd-8d74-0386ab680f66 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:35.863071 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-ee502f1d-6c12-48dd-8d74-0386ab680f66 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:35.864168 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-ee502f1d-6c12-48dd-8d74-0386ab680f66 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:35.868991 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-ee502f1d-6c12-48dd-8d74-0386ab680f66 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:36.061109 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-ee502f1d-6c12-48dd-8d74-0386ab680f66 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:36.061474 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-ee502f1d-6c12-48dd-8d74-0386ab680f66 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:36.061961 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.objects.instance [None req-ee502f1d-6c12-48dd-8d74-0386ab680f66 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Lazy-loading 'fault' on Instance uuid 2b37b708-5d64-4e1f-9e17-32f528641ca5 {{(pid=118514) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 26 14:58:36.108542 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-c41962c1-2f6e-44e3-b29e-a18055d11f6b tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "POST /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59/action" status: 200 len: 14 microversion: 2.1 time: 0.310272 May 26 14:58:36.110719 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 73/141] 10.222.0.81 () {60 vars in 1278 bytes} [Wed May 26 14:58:35 2021] POST /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59/action => generated 14 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 26 14:58:36.148446 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-f153a2ca-b218-4fa4-8985-dbd8ae690564 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:58:36.155522 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-f153a2ca-b218-4fa4-8985-dbd8ae690564 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 598b0e3f-8cf1-451a-80a8-ed7e5dd36984] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:58:36.165825 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-f153a2ca-b218-4fa4-8985-dbd8ae690564 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:36.166862 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-f153a2ca-b218-4fa4-8985-dbd8ae690564 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:36.167864 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-f153a2ca-b218-4fa4-8985-dbd8ae690564 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:36.168521 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-f153a2ca-b218-4fa4-8985-dbd8ae690564 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:36.306844 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-f153a2ca-b218-4fa4-8985-dbd8ae690564 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "POST /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984/action" status: 200 len: 14 microversion: 2.20 time: 0.162856 May 26 14:58:36.307488 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 74/142] 10.222.0.81 () {62 vars in 1319 bytes} [Wed May 26 14:58:36 2021] POST /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984/action => generated 14 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 14:58:36.355803 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-ee502f1d-6c12-48dd-8d74-0386ab680f66 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d6fb430257a489c8b8a1890ecb5ea93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0f665681e524725b9abb121531f47a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:58:36.367133 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-ee502f1d-6c12-48dd-8d74-0386ab680f66 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] 10.222.0.81 "GET /compute/v2.1/servers/2b37b708-5d64-4e1f-9e17-32f528641ca5" status: 200 len: 1350 microversion: 2.1 time: 0.542196 May 26 14:58:36.368417 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 69/143] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:58:35 2021] GET /compute/v2.1/servers/2b37b708-5d64-4e1f-9e17-32f528641ca5 => generated 1350 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:58:36.492052 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-9bd5289f-5b12-40ff-a563-8759d00fcf0d tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:58:36.492833 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-9bd5289f-5b12-40ff-a563-8759d00fcf0d tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] [instance: acc03344-b5df-4277-82e4-c9b3228969ca] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:58:36.504033 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-9bd5289f-5b12-40ff-a563-8759d00fcf0d tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:36.504599 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-9bd5289f-5b12-40ff-a563-8759d00fcf0d tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:36.505511 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-9bd5289f-5b12-40ff-a563-8759d00fcf0d tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:36.506577 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-9bd5289f-5b12-40ff-a563-8759d00fcf0d tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:36.756950 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-9bd5289f-5b12-40ff-a563-8759d00fcf0d tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b167942c895345b186a3eda5c82175b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad2ab2705ca479ab4aaafe7c80de162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:58:36.767107 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-9bd5289f-5b12-40ff-a563-8759d00fcf0d tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /compute/v2.1/servers/acc03344-b5df-4277-82e4-c9b3228969ca" status: 200 len: 1522 microversion: 2.1 time: 0.279283 May 26 14:58:36.770039 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 75/144] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:58:36 2021] GET /compute/v2.1/servers/acc03344-b5df-4277-82e4-c9b3228969ca => generated 1522 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:58:37.123165 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-aa996aea-6813-4faa-ae56-1702c4211906 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:58:37.124071 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-aa996aea-6813-4faa-ae56-1702c4211906 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: a9d8f9a6-bd66-4caa-8662-4bb94655ae59] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:58:37.132298 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-aa996aea-6813-4faa-ae56-1702c4211906 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:37.132782 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-aa996aea-6813-4faa-ae56-1702c4211906 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:37.133596 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-aa996aea-6813-4faa-ae56-1702c4211906 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:37.134041 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-aa996aea-6813-4faa-ae56-1702c4211906 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:37.252697 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-aa996aea-6813-4faa-ae56-1702c4211906 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "POST /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59/action" status: 200 len: 14 microversion: 2.1 time: 0.133101 May 26 14:58:37.253640 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 70/145] 10.222.0.81 () {60 vars in 1278 bytes} [Wed May 26 14:58:37 2021] POST /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59/action => generated 14 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 26 14:58:37.319360 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-05aabf50-adcc-40be-ab94-d455e4af029d tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:58:37.321029 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-05aabf50-adcc-40be-ab94-d455e4af029d tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 598b0e3f-8cf1-451a-80a8-ed7e5dd36984] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:58:37.333516 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-05aabf50-adcc-40be-ab94-d455e4af029d tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:37.334167 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-05aabf50-adcc-40be-ab94-d455e4af029d tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:37.335183 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-05aabf50-adcc-40be-ab94-d455e4af029d tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:37.335732 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-05aabf50-adcc-40be-ab94-d455e4af029d tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:37.384620 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-b5c1fe23-03af-4287-be40-d132728fdcd3 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:58:37.385319 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-b5c1fe23-03af-4287-be40-d132728fdcd3 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] [instance: 2b37b708-5d64-4e1f-9e17-32f528641ca5] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:58:37.396341 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-b5c1fe23-03af-4287-be40-d132728fdcd3 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:37.397151 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-b5c1fe23-03af-4287-be40-d132728fdcd3 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:37.397658 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-b5c1fe23-03af-4287-be40-d132728fdcd3 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:37.408887 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-b5c1fe23-03af-4287-be40-d132728fdcd3 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:37.475127 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-05aabf50-adcc-40be-ab94-d455e4af029d tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "POST /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984/action" status: 200 len: 14 microversion: 2.20 time: 0.160997 May 26 14:58:37.476411 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 76/146] 10.222.0.81 () {62 vars in 1319 bytes} [Wed May 26 14:58:37 2021] POST /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984/action => generated 14 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:58:37.496617 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.wsgi [None req-b5c1fe23-03af-4287-be40-d132728fdcd3 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] HTTP exception thrown: Instance 2b37b708-5d64-4e1f-9e17-32f528641ca5 could not be found. May 26 14:58:37.498292 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-b5c1fe23-03af-4287-be40-d132728fdcd3 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Returning 404 to user: Instance 2b37b708-5d64-4e1f-9e17-32f528641ca5 could not be found. {{(pid=118514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 26 14:58:37.499457 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-b5c1fe23-03af-4287-be40-d132728fdcd3 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] 10.222.0.81 "GET /compute/v2.1/servers/2b37b708-5d64-4e1f-9e17-32f528641ca5" status: 404 len: 111 microversion: 2.1 time: 0.119004 May 26 14:58:37.505353 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 71/147] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:58:37 2021] GET /compute/v2.1/servers/2b37b708-5d64-4e1f-9e17-32f528641ca5 => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 26 14:58:37.786971 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-62aa57c0-18e8-4d15-88a0-42fc990ac2e3 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:58:37.787668 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-62aa57c0-18e8-4d15-88a0-42fc990ac2e3 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] [instance: acc03344-b5df-4277-82e4-c9b3228969ca] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:58:37.801222 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-62aa57c0-18e8-4d15-88a0-42fc990ac2e3 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:37.801687 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-62aa57c0-18e8-4d15-88a0-42fc990ac2e3 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:37.811173 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-62aa57c0-18e8-4d15-88a0-42fc990ac2e3 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:37.811881 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-62aa57c0-18e8-4d15-88a0-42fc990ac2e3 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:38.116749 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-62aa57c0-18e8-4d15-88a0-42fc990ac2e3 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b167942c895345b186a3eda5c82175b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad2ab2705ca479ab4aaafe7c80de162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:58:38.125711 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-62aa57c0-18e8-4d15-88a0-42fc990ac2e3 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /compute/v2.1/servers/acc03344-b5df-4277-82e4-c9b3228969ca" status: 200 len: 1522 microversion: 2.1 time: 0.343447 May 26 14:58:38.136615 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 77/148] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:58:37 2021] GET /compute/v2.1/servers/acc03344-b5df-4277-82e4-c9b3228969ca => generated 1522 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:58:38.263125 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-d81921fa-ea45-470f-9769-7618b7da4f2b tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:58:38.264166 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-d81921fa-ea45-470f-9769-7618b7da4f2b tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: a9d8f9a6-bd66-4caa-8662-4bb94655ae59] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:58:38.271618 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-d81921fa-ea45-470f-9769-7618b7da4f2b tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:38.272074 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-d81921fa-ea45-470f-9769-7618b7da4f2b tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:38.272863 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-d81921fa-ea45-470f-9769-7618b7da4f2b tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:38.274039 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-d81921fa-ea45-470f-9769-7618b7da4f2b tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:38.383779 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-d81921fa-ea45-470f-9769-7618b7da4f2b tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "POST /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59/action" status: 200 len: 14 microversion: 2.1 time: 0.124069 May 26 14:58:38.384416 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 72/149] 10.222.0.81 () {60 vars in 1278 bytes} [Wed May 26 14:58:38 2021] POST /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59/action => generated 14 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 26 14:58:38.487953 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-95a2b0d1-75c1-45a8-9ccc-324e3ef299f9 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:58:38.492829 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-95a2b0d1-75c1-45a8-9ccc-324e3ef299f9 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 598b0e3f-8cf1-451a-80a8-ed7e5dd36984] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:58:38.497663 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-95a2b0d1-75c1-45a8-9ccc-324e3ef299f9 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:38.498201 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-95a2b0d1-75c1-45a8-9ccc-324e3ef299f9 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:38.499376 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-95a2b0d1-75c1-45a8-9ccc-324e3ef299f9 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:38.500020 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-95a2b0d1-75c1-45a8-9ccc-324e3ef299f9 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:38.602966 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-95a2b0d1-75c1-45a8-9ccc-324e3ef299f9 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "POST /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984/action" status: 200 len: 14 microversion: 2.20 time: 0.119391 May 26 14:58:38.604315 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 78/150] 10.222.0.81 () {62 vars in 1319 bytes} [Wed May 26 14:58:38 2021] POST /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984/action => generated 14 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:58:39.145560 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-2b6b2bd3-53c4-4f7c-9be6-3e4d19377ed8 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:58:39.146862 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-2b6b2bd3-53c4-4f7c-9be6-3e4d19377ed8 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] [instance: acc03344-b5df-4277-82e4-c9b3228969ca] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:58:39.156428 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-2b6b2bd3-53c4-4f7c-9be6-3e4d19377ed8 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:39.157258 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-2b6b2bd3-53c4-4f7c-9be6-3e4d19377ed8 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:39.158633 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-2b6b2bd3-53c4-4f7c-9be6-3e4d19377ed8 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:39.159544 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-2b6b2bd3-53c4-4f7c-9be6-3e4d19377ed8 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:39.379161 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-2b6b2bd3-53c4-4f7c-9be6-3e4d19377ed8 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b167942c895345b186a3eda5c82175b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad2ab2705ca479ab4aaafe7c80de162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:58:39.394550 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-2b6b2bd3-53c4-4f7c-9be6-3e4d19377ed8 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /compute/v2.1/servers/acc03344-b5df-4277-82e4-c9b3228969ca" status: 200 len: 1522 microversion: 2.1 time: 0.254309 May 26 14:58:39.404530 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-44b85c02-11e3-45d3-ba18-bb382bccc028 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:58:39.405179 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-44b85c02-11e3-45d3-ba18-bb382bccc028 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: a9d8f9a6-bd66-4caa-8662-4bb94655ae59] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:58:39.405602 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 73/151] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:58:39 2021] GET /compute/v2.1/servers/acc03344-b5df-4277-82e4-c9b3228969ca => generated 1522 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:58:39.415758 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-44b85c02-11e3-45d3-ba18-bb382bccc028 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:39.416579 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-44b85c02-11e3-45d3-ba18-bb382bccc028 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:39.417835 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-44b85c02-11e3-45d3-ba18-bb382bccc028 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:39.418699 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-44b85c02-11e3-45d3-ba18-bb382bccc028 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:39.472314 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-5a94c8c2-51b1-4268-b5ce-58cf3d9c0e57 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:58:39.473270 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-5a94c8c2-51b1-4268-b5ce-58cf3d9c0e57 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] [instance: 2b37b708-5d64-4e1f-9e17-32f528641ca5] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:58:39.482063 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-5a94c8c2-51b1-4268-b5ce-58cf3d9c0e57 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:39.483673 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-5a94c8c2-51b1-4268-b5ce-58cf3d9c0e57 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:39.484661 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-5a94c8c2-51b1-4268-b5ce-58cf3d9c0e57 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:39.485314 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-5a94c8c2-51b1-4268-b5ce-58cf3d9c0e57 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:39.536810 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-44b85c02-11e3-45d3-ba18-bb382bccc028 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "POST /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59/action" status: 200 len: 6451 microversion: 2.1 time: 0.140525 May 26 14:58:39.545033 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 79/152] 10.222.0.81 () {60 vars in 1278 bytes} [Wed May 26 14:58:39 2021] POST /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59/action => generated 6451 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:58:39.545951 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.wsgi [None req-5a94c8c2-51b1-4268-b5ce-58cf3d9c0e57 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] HTTP exception thrown: Instance 2b37b708-5d64-4e1f-9e17-32f528641ca5 could not be found. May 26 14:58:39.546768 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-5a94c8c2-51b1-4268-b5ce-58cf3d9c0e57 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Returning 404 to user: Instance 2b37b708-5d64-4e1f-9e17-32f528641ca5 could not be found. {{(pid=118514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 26 14:58:39.547807 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-5a94c8c2-51b1-4268-b5ce-58cf3d9c0e57 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] 10.222.0.81 "DELETE /compute/v2.1/servers/2b37b708-5d64-4e1f-9e17-32f528641ca5" status: 404 len: 111 microversion: 2.1 time: 0.084020 May 26 14:58:39.550045 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 74/153] 10.222.0.81 () {58 vars in 1239 bytes} [Wed May 26 14:58:39 2021] DELETE /compute/v2.1/servers/2b37b708-5d64-4e1f-9e17-32f528641ca5 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 14:58:39.558950 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-e2d7d73a-b55f-460d-baa5-8e623a4f76c8 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:58:39.559847 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-e2d7d73a-b55f-460d-baa5-8e623a4f76c8 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] [instance: 2b37b708-5d64-4e1f-9e17-32f528641ca5] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:58:39.582958 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-e2d7d73a-b55f-460d-baa5-8e623a4f76c8 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:39.583437 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-e2d7d73a-b55f-460d-baa5-8e623a4f76c8 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:39.584238 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-e2d7d73a-b55f-460d-baa5-8e623a4f76c8 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:39.585044 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-e2d7d73a-b55f-460d-baa5-8e623a4f76c8 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:39.617209 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-ba5b663e-1f34-482f-bc18-fb8c7ffd104a tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:58:39.618343 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-ba5b663e-1f34-482f-bc18-fb8c7ffd104a tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 598b0e3f-8cf1-451a-80a8-ed7e5dd36984] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:58:39.627709 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-ba5b663e-1f34-482f-bc18-fb8c7ffd104a tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:39.629066 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-ba5b663e-1f34-482f-bc18-fb8c7ffd104a tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:39.630053 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-ba5b663e-1f34-482f-bc18-fb8c7ffd104a tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:39.635693 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-ba5b663e-1f34-482f-bc18-fb8c7ffd104a tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:39.677511 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.wsgi [None req-e2d7d73a-b55f-460d-baa5-8e623a4f76c8 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] HTTP exception thrown: Instance 2b37b708-5d64-4e1f-9e17-32f528641ca5 could not be found. May 26 14:58:39.678874 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-e2d7d73a-b55f-460d-baa5-8e623a4f76c8 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] Returning 404 to user: Instance 2b37b708-5d64-4e1f-9e17-32f528641ca5 could not be found. {{(pid=118513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 26 14:58:39.683424 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-e2d7d73a-b55f-460d-baa5-8e623a4f76c8 tempest-DeleteServersTestJSON-399450799 tempest-DeleteServersTestJSON-399450799-project] 10.222.0.81 "GET /compute/v2.1/servers/2b37b708-5d64-4e1f-9e17-32f528641ca5" status: 404 len: 111 microversion: 2.1 time: 0.129697 May 26 14:58:39.689684 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 80/154] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:58:39 2021] GET /compute/v2.1/servers/2b37b708-5d64-4e1f-9e17-32f528641ca5 => generated 111 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 14:58:39.759554 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-ba5b663e-1f34-482f-bc18-fb8c7ffd104a tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "POST /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984/action" status: 200 len: 14 microversion: 2.20 time: 0.146246 May 26 14:58:39.761772 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 75/155] 10.222.0.81 () {62 vars in 1319 bytes} [Wed May 26 14:58:39 2021] POST /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984/action => generated 14 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:58:40.413108 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-8e408b90-b8f6-4eaf-a266-0820147dc62c tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:58:40.414140 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-8e408b90-b8f6-4eaf-a266-0820147dc62c tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] [instance: acc03344-b5df-4277-82e4-c9b3228969ca] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:58:40.426793 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-8e408b90-b8f6-4eaf-a266-0820147dc62c tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:40.427878 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-8e408b90-b8f6-4eaf-a266-0820147dc62c tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:40.428895 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-8e408b90-b8f6-4eaf-a266-0820147dc62c tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:40.430208 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-8e408b90-b8f6-4eaf-a266-0820147dc62c tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:40.552788 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-906f3d39-2d69-4e88-808c-3a345722f362 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:58:40.554267 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-906f3d39-2d69-4e88-808c-3a345722f362 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: a9d8f9a6-bd66-4caa-8662-4bb94655ae59] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:58:40.564841 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-906f3d39-2d69-4e88-808c-3a345722f362 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:40.565861 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-906f3d39-2d69-4e88-808c-3a345722f362 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:40.566717 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-906f3d39-2d69-4e88-808c-3a345722f362 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:40.567156 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-906f3d39-2d69-4e88-808c-3a345722f362 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:40.672113 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-906f3d39-2d69-4e88-808c-3a345722f362 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "POST /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59/action" status: 200 len: 13501 microversion: 2.1 time: 0.123694 May 26 14:58:40.673006 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 76/156] 10.222.0.81 () {60 vars in 1278 bytes} [Wed May 26 14:58:40 2021] POST /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59/action => generated 13501 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 26 14:58:40.779892 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-c2ef14b2-3675-4008-b656-f7ff4f0c77df tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:58:40.783213 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-c2ef14b2-3675-4008-b656-f7ff4f0c77df tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 598b0e3f-8cf1-451a-80a8-ed7e5dd36984] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:58:40.800553 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-c2ef14b2-3675-4008-b656-f7ff4f0c77df tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:40.802091 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-c2ef14b2-3675-4008-b656-f7ff4f0c77df tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:40.803449 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-c2ef14b2-3675-4008-b656-f7ff4f0c77df tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:40.805688 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-c2ef14b2-3675-4008-b656-f7ff4f0c77df tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:40.927154 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-c2ef14b2-3675-4008-b656-f7ff4f0c77df tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "POST /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984/action" status: 200 len: 14 microversion: 2.20 time: 0.156680 May 26 14:58:40.934920 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 77/157] 10.222.0.81 () {62 vars in 1319 bytes} [Wed May 26 14:58:40 2021] POST /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984/action => generated 14 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:58:41.034558 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-8e408b90-b8f6-4eaf-a266-0820147dc62c tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b167942c895345b186a3eda5c82175b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad2ab2705ca479ab4aaafe7c80de162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:58:41.043558 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-8e408b90-b8f6-4eaf-a266-0820147dc62c tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /compute/v2.1/servers/acc03344-b5df-4277-82e4-c9b3228969ca" status: 200 len: 1522 microversion: 2.1 time: 0.635738 May 26 14:58:41.044346 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 81/158] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:58:40 2021] GET /compute/v2.1/servers/acc03344-b5df-4277-82e4-c9b3228969ca => generated 1522 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:58:41.687133 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-ad652a78-2c23-4e13-9263-b33014e7c41d tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:58:41.690104 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-ad652a78-2c23-4e13-9263-b33014e7c41d tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: a9d8f9a6-bd66-4caa-8662-4bb94655ae59] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:58:41.699975 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-ad652a78-2c23-4e13-9263-b33014e7c41d tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:41.700985 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-ad652a78-2c23-4e13-9263-b33014e7c41d tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:41.702126 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-ad652a78-2c23-4e13-9263-b33014e7c41d tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:41.702870 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-ad652a78-2c23-4e13-9263-b33014e7c41d tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:41.840911 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-ad652a78-2c23-4e13-9263-b33014e7c41d tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "POST /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59/action" status: 200 len: 17931 microversion: 2.1 time: 0.159024 May 26 14:58:41.841622 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 78/159] 10.222.0.81 () {60 vars in 1278 bytes} [Wed May 26 14:58:41 2021] POST /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59/action => generated 17931 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 14:58:41.938482 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-09b51a9f-8d3f-4070-a721-8960f943c2aa tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:58:41.939973 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-09b51a9f-8d3f-4070-a721-8960f943c2aa tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 598b0e3f-8cf1-451a-80a8-ed7e5dd36984] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:58:41.947504 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-09b51a9f-8d3f-4070-a721-8960f943c2aa tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:41.947967 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-09b51a9f-8d3f-4070-a721-8960f943c2aa tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:41.948752 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-09b51a9f-8d3f-4070-a721-8960f943c2aa tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:41.949249 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-09b51a9f-8d3f-4070-a721-8960f943c2aa tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:42.047305 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-09b51a9f-8d3f-4070-a721-8960f943c2aa tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "POST /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984/action" status: 200 len: 14 microversion: 2.20 time: 0.112335 May 26 14:58:42.049190 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 82/160] 10.222.0.81 () {62 vars in 1319 bytes} [Wed May 26 14:58:41 2021] POST /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984/action => generated 14 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:58:42.065391 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-33d9f2ea-8554-4d18-a968-683e1bbd6ed6 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:58:42.065391 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-33d9f2ea-8554-4d18-a968-683e1bbd6ed6 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] [instance: acc03344-b5df-4277-82e4-c9b3228969ca] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:58:42.072561 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-33d9f2ea-8554-4d18-a968-683e1bbd6ed6 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:42.073356 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-33d9f2ea-8554-4d18-a968-683e1bbd6ed6 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:42.075015 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-33d9f2ea-8554-4d18-a968-683e1bbd6ed6 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:42.075685 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-33d9f2ea-8554-4d18-a968-683e1bbd6ed6 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:42.342980 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-33d9f2ea-8554-4d18-a968-683e1bbd6ed6 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b167942c895345b186a3eda5c82175b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad2ab2705ca479ab4aaafe7c80de162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:58:42.353779 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-33d9f2ea-8554-4d18-a968-683e1bbd6ed6 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /compute/v2.1/servers/acc03344-b5df-4277-82e4-c9b3228969ca" status: 200 len: 1522 microversion: 2.1 time: 0.297123 May 26 14:58:42.365500 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 79/161] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:58:42 2021] GET /compute/v2.1/servers/acc03344-b5df-4277-82e4-c9b3228969ca => generated 1522 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:58:42.853149 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-7a0f8dd5-8672-4959-bc33-42376b524f75 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:58:42.854383 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-7a0f8dd5-8672-4959-bc33-42376b524f75 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: a9d8f9a6-bd66-4caa-8662-4bb94655ae59] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:58:42.862650 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-7a0f8dd5-8672-4959-bc33-42376b524f75 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:42.863329 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-7a0f8dd5-8672-4959-bc33-42376b524f75 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:42.864292 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-7a0f8dd5-8672-4959-bc33-42376b524f75 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:42.864743 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-7a0f8dd5-8672-4959-bc33-42376b524f75 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:42.978514 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-7a0f8dd5-8672-4959-bc33-42376b524f75 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "POST /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59/action" status: 200 len: 18208 microversion: 2.1 time: 0.129262 May 26 14:58:42.982635 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 83/162] 10.222.0.81 () {60 vars in 1278 bytes} [Wed May 26 14:58:42 2021] POST /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59/action => generated 18208 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 14:58:43.064534 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-2197d408-190e-4906-8a8b-46f4f6bf7a66 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:58:43.066235 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-2197d408-190e-4906-8a8b-46f4f6bf7a66 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 598b0e3f-8cf1-451a-80a8-ed7e5dd36984] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:58:43.074294 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-2197d408-190e-4906-8a8b-46f4f6bf7a66 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:43.074721 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-2197d408-190e-4906-8a8b-46f4f6bf7a66 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:43.075613 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-2197d408-190e-4906-8a8b-46f4f6bf7a66 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:43.076052 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-2197d408-190e-4906-8a8b-46f4f6bf7a66 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:43.184581 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-2197d408-190e-4906-8a8b-46f4f6bf7a66 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "POST /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984/action" status: 200 len: 14 microversion: 2.20 time: 0.127884 May 26 14:58:43.185205 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 80/163] 10.222.0.81 () {62 vars in 1319 bytes} [Wed May 26 14:58:43 2021] POST /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984/action => generated 14 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:58:43.373804 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-c8fa867b-9100-4804-a852-745ffe1c3d1b tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:58:43.374631 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-c8fa867b-9100-4804-a852-745ffe1c3d1b tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] [instance: acc03344-b5df-4277-82e4-c9b3228969ca] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:58:43.383746 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-c8fa867b-9100-4804-a852-745ffe1c3d1b tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:43.384276 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-c8fa867b-9100-4804-a852-745ffe1c3d1b tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:43.385074 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-c8fa867b-9100-4804-a852-745ffe1c3d1b tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:43.385524 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-c8fa867b-9100-4804-a852-745ffe1c3d1b tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:43.612429 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-c8fa867b-9100-4804-a852-745ffe1c3d1b tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b167942c895345b186a3eda5c82175b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad2ab2705ca479ab4aaafe7c80de162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:58:43.620744 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-c8fa867b-9100-4804-a852-745ffe1c3d1b tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /compute/v2.1/servers/acc03344-b5df-4277-82e4-c9b3228969ca" status: 200 len: 1522 microversion: 2.1 time: 0.251300 May 26 14:58:43.621310 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 84/164] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:58:43 2021] GET /compute/v2.1/servers/acc03344-b5df-4277-82e4-c9b3228969ca => generated 1522 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:58:43.991493 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-43c9429e-bd46-44f0-be77-67389195c6e9 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:58:43.992497 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-43c9429e-bd46-44f0-be77-67389195c6e9 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: a9d8f9a6-bd66-4caa-8662-4bb94655ae59] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:58:44.002028 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-43c9429e-bd46-44f0-be77-67389195c6e9 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:44.002392 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-43c9429e-bd46-44f0-be77-67389195c6e9 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:44.003285 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-43c9429e-bd46-44f0-be77-67389195c6e9 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:44.003794 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-43c9429e-bd46-44f0-be77-67389195c6e9 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:44.113860 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-43c9429e-bd46-44f0-be77-67389195c6e9 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "POST /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59/action" status: 200 len: 20991 microversion: 2.1 time: 0.126661 May 26 14:58:44.119559 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 81/165] 10.222.0.81 () {60 vars in 1278 bytes} [Wed May 26 14:58:43 2021] POST /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59/action => generated 20991 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 14:58:44.195310 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-9f2d07d2-5fb3-46c1-95ea-94a77659badf tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:58:44.196444 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-9f2d07d2-5fb3-46c1-95ea-94a77659badf tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 598b0e3f-8cf1-451a-80a8-ed7e5dd36984] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:58:44.205951 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-9f2d07d2-5fb3-46c1-95ea-94a77659badf tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:44.207972 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-9f2d07d2-5fb3-46c1-95ea-94a77659badf tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:44.209848 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-9f2d07d2-5fb3-46c1-95ea-94a77659badf tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:44.210189 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-9f2d07d2-5fb3-46c1-95ea-94a77659badf tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:44.326413 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-9f2d07d2-5fb3-46c1-95ea-94a77659badf tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "POST /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984/action" status: 200 len: 14 microversion: 2.20 time: 0.134489 May 26 14:58:44.327430 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 85/166] 10.222.0.81 () {62 vars in 1319 bytes} [Wed May 26 14:58:44 2021] POST /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984/action => generated 14 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:58:44.640056 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-8bd2920c-2428-450e-aed7-a96925330183 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:58:44.640992 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-8bd2920c-2428-450e-aed7-a96925330183 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] [instance: acc03344-b5df-4277-82e4-c9b3228969ca] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:58:44.651340 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-8bd2920c-2428-450e-aed7-a96925330183 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:44.655593 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-8bd2920c-2428-450e-aed7-a96925330183 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:44.656569 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-8bd2920c-2428-450e-aed7-a96925330183 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:44.657161 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-8bd2920c-2428-450e-aed7-a96925330183 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:45.000752 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-8bd2920c-2428-450e-aed7-a96925330183 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b167942c895345b186a3eda5c82175b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad2ab2705ca479ab4aaafe7c80de162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:58:45.009873 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-8bd2920c-2428-450e-aed7-a96925330183 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /compute/v2.1/servers/acc03344-b5df-4277-82e4-c9b3228969ca" status: 200 len: 1522 microversion: 2.1 time: 0.374022 May 26 14:58:45.010908 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 82/167] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:58:44 2021] GET /compute/v2.1/servers/acc03344-b5df-4277-82e4-c9b3228969ca => generated 1522 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:58:45.129455 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-52ddd66e-f263-4b1f-8a94-c637c208f173 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:58:45.131440 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-52ddd66e-f263-4b1f-8a94-c637c208f173 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: a9d8f9a6-bd66-4caa-8662-4bb94655ae59] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:58:45.145089 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-52ddd66e-f263-4b1f-8a94-c637c208f173 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:45.145727 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-52ddd66e-f263-4b1f-8a94-c637c208f173 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:45.146698 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-52ddd66e-f263-4b1f-8a94-c637c208f173 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:45.147942 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-52ddd66e-f263-4b1f-8a94-c637c208f173 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:45.270661 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-52ddd66e-f263-4b1f-8a94-c637c208f173 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "POST /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59/action" status: 200 len: 22540 microversion: 2.1 time: 0.147387 May 26 14:58:45.272873 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 86/168] 10.222.0.81 () {60 vars in 1278 bytes} [Wed May 26 14:58:45 2021] POST /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59/action => generated 22540 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 14:58:45.338016 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-2bfcf150-5988-4578-86a1-5680b2bce21d tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:58:45.339794 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-2bfcf150-5988-4578-86a1-5680b2bce21d tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 598b0e3f-8cf1-451a-80a8-ed7e5dd36984] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:58:45.348210 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-2bfcf150-5988-4578-86a1-5680b2bce21d tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:45.348989 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-2bfcf150-5988-4578-86a1-5680b2bce21d tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:45.350276 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-2bfcf150-5988-4578-86a1-5680b2bce21d tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:45.351044 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-2bfcf150-5988-4578-86a1-5680b2bce21d tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:45.470030 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-2bfcf150-5988-4578-86a1-5680b2bce21d tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "POST /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984/action" status: 200 len: 3903 microversion: 2.20 time: 0.135693 May 26 14:58:45.472788 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 83/169] 10.222.0.81 () {62 vars in 1319 bytes} [Wed May 26 14:58:45 2021] POST /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984/action => generated 3903 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:58:46.028285 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-5787beda-f2cf-42d9-851a-22c9794f9a9e tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:58:46.029088 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-5787beda-f2cf-42d9-851a-22c9794f9a9e tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] [instance: acc03344-b5df-4277-82e4-c9b3228969ca] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:58:46.038160 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-5787beda-f2cf-42d9-851a-22c9794f9a9e tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:46.038654 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-5787beda-f2cf-42d9-851a-22c9794f9a9e tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:46.039472 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-5787beda-f2cf-42d9-851a-22c9794f9a9e tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:46.039919 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-5787beda-f2cf-42d9-851a-22c9794f9a9e tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:46.285876 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-ce1f5744-0d61-4337-a965-b86abde2e498 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:58:46.286908 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-ce1f5744-0d61-4337-a965-b86abde2e498 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: a9d8f9a6-bd66-4caa-8662-4bb94655ae59] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:58:46.306340 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-ce1f5744-0d61-4337-a965-b86abde2e498 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:46.306806 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-ce1f5744-0d61-4337-a965-b86abde2e498 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:46.307611 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-ce1f5744-0d61-4337-a965-b86abde2e498 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:46.310074 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-ce1f5744-0d61-4337-a965-b86abde2e498 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:46.323507 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-5787beda-f2cf-42d9-851a-22c9794f9a9e tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b167942c895345b186a3eda5c82175b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad2ab2705ca479ab4aaafe7c80de162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:58:46.337460 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-5787beda-f2cf-42d9-851a-22c9794f9a9e tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /compute/v2.1/servers/acc03344-b5df-4277-82e4-c9b3228969ca" status: 200 len: 1522 microversion: 2.1 time: 0.313403 May 26 14:58:46.338125 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 87/170] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:58:46 2021] GET /compute/v2.1/servers/acc03344-b5df-4277-82e4-c9b3228969ca => generated 1522 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:58:46.440665 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-ce1f5744-0d61-4337-a965-b86abde2e498 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "POST /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59/action" status: 200 len: 23793 microversion: 2.1 time: 0.159530 May 26 14:58:46.441934 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 84/171] 10.222.0.81 () {60 vars in 1278 bytes} [Wed May 26 14:58:46 2021] POST /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59/action => generated 23793 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 26 14:58:46.481045 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-2a961236-ef6a-4910-a176-9d5424d4505c tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:58:46.482421 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-2a961236-ef6a-4910-a176-9d5424d4505c tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 598b0e3f-8cf1-451a-80a8-ed7e5dd36984] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:58:46.492969 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-2a961236-ef6a-4910-a176-9d5424d4505c tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:46.494056 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-2a961236-ef6a-4910-a176-9d5424d4505c tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:46.497857 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-2a961236-ef6a-4910-a176-9d5424d4505c tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:46.499844 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-2a961236-ef6a-4910-a176-9d5424d4505c tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:46.630075 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-2a961236-ef6a-4910-a176-9d5424d4505c tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "POST /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984/action" status: 200 len: 11535 microversion: 2.20 time: 0.152510 May 26 14:58:46.631203 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 88/172] 10.222.0.81 () {62 vars in 1319 bytes} [Wed May 26 14:58:46 2021] POST /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984/action => generated 11535 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 26 14:58:46.697823 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-04487f42-3bb3-4a9b-8005-e5bde0e25d16 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-541967452", "imageRef": "dcacad62-e278-4869-aa20-e5df07dd03db", "flavorRef": "452", "networks": [{"uuid": "5bdb145e-267b-43cd-9426-f92f373c5ed5"}]}} {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:58:46.775816 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.network.neutron [None req-04487f42-3bb3-4a9b-8005-e5bde0e25d16 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] validate_networks() for [('5bdb145e-267b-43cd-9426-f92f373c5ed5', None, None, None)] {{(pid=118514) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} May 26 14:58:47.366616 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-46a3bb4c-3665-429c-b4fe-ef018eee33ae tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:58:47.369980 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-46a3bb4c-3665-429c-b4fe-ef018eee33ae tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] [instance: acc03344-b5df-4277-82e4-c9b3228969ca] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:58:47.382059 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-46a3bb4c-3665-429c-b4fe-ef018eee33ae tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:47.382715 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-46a3bb4c-3665-429c-b4fe-ef018eee33ae tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:47.383863 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-46a3bb4c-3665-429c-b4fe-ef018eee33ae tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:47.384453 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-46a3bb4c-3665-429c-b4fe-ef018eee33ae tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:47.535682 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.virt.hardware [None req-04487f42-3bb3-4a9b-8005-e5bde0e25d16 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Flavor limits 0:0:0 {{(pid=118514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} May 26 14:58:47.536211 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.virt.hardware [None req-04487f42-3bb3-4a9b-8005-e5bde0e25d16 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Image limits 0:0:0 {{(pid=118514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} May 26 14:58:47.536734 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.virt.hardware [None req-04487f42-3bb3-4a9b-8005-e5bde0e25d16 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Flavor pref 0:0:0 {{(pid=118514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} May 26 14:58:47.537159 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.virt.hardware [None req-04487f42-3bb3-4a9b-8005-e5bde0e25d16 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Image pref 0:0:0 {{(pid=118514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} May 26 14:58:47.537598 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.virt.hardware [None req-04487f42-3bb3-4a9b-8005-e5bde0e25d16 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} May 26 14:58:47.548029 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-04487f42-3bb3-4a9b-8005-e5bde0e25d16 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:47.549069 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-04487f42-3bb3-4a9b-8005-e5bde0e25d16 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:47.550236 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-04487f42-3bb3-4a9b-8005-e5bde0e25d16 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:47.550676 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-04487f42-3bb3-4a9b-8005-e5bde0e25d16 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:47.568480 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.quota [None req-04487f42-3bb3-4a9b-8005-e5bde0e25d16 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Getting quotas for project 1515325707f64d58a28f26451b2c74de. Resources: {'instances', 'ram', 'cores'} {{(pid=118514) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 26 14:58:47.572595 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.quota [None req-04487f42-3bb3-4a9b-8005-e5bde0e25d16 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Getting quotas for user 1be4bd5c0f2a400da491bae101b48832 and project 1515325707f64d58a28f26451b2c74de. Resources: {'instances', 'ram', 'cores'} {{(pid=118514) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 26 14:58:47.585411 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-04487f42-3bb3-4a9b-8005-e5bde0e25d16 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Going to run 1 instances... {{(pid=118514) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 26 14:58:47.587533 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-04487f42-3bb3-4a9b-8005-e5bde0e25d16 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] [instance: 396d0570-c547-4549-8fe6-dd156ef64c4b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dcacad62-e278-4869-aa20-e5df07dd03db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118514) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} May 26 14:58:47.636302 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-46a3bb4c-3665-429c-b4fe-ef018eee33ae tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b167942c895345b186a3eda5c82175b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad2ab2705ca479ab4aaafe7c80de162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:58:47.645232 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-46a3bb4c-3665-429c-b4fe-ef018eee33ae tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /compute/v2.1/servers/acc03344-b5df-4277-82e4-c9b3228969ca" status: 200 len: 1522 microversion: 2.1 time: 0.292978 May 26 14:58:47.645852 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 89/173] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:58:47 2021] GET /compute/v2.1/servers/acc03344-b5df-4277-82e4-c9b3228969ca => generated 1522 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:58:47.650248 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-590e0d10-9dc3-4dda-8da0-b4609bd0d076 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:58:47.651212 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-590e0d10-9dc3-4dda-8da0-b4609bd0d076 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: a9d8f9a6-bd66-4caa-8662-4bb94655ae59] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:58:47.658902 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-590e0d10-9dc3-4dda-8da0-b4609bd0d076 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:47.659364 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-590e0d10-9dc3-4dda-8da0-b4609bd0d076 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:47.660136 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-590e0d10-9dc3-4dda-8da0-b4609bd0d076 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:47.660579 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-590e0d10-9dc3-4dda-8da0-b4609bd0d076 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:47.727301 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-04487f42-3bb3-4a9b-8005-e5bde0e25d16 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.160767 May 26 14:58:47.728625 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 85/174] 10.222.0.81 () {60 vars in 1147 bytes} [Wed May 26 14:58:46 2021] POST /compute/v2.1/servers => generated 380 bytes in 1163 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 26 14:58:47.733788 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-242b84c7-a90f-46d9-93a9-e7cab6f354a1 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:58:47.734775 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-242b84c7-a90f-46d9-93a9-e7cab6f354a1 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 598b0e3f-8cf1-451a-80a8-ed7e5dd36984] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:58:47.744196 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-242b84c7-a90f-46d9-93a9-e7cab6f354a1 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:47.744839 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-242b84c7-a90f-46d9-93a9-e7cab6f354a1 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:47.745838 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-242b84c7-a90f-46d9-93a9-e7cab6f354a1 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:47.746282 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-242b84c7-a90f-46d9-93a9-e7cab6f354a1 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:47.785912 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-590e0d10-9dc3-4dda-8da0-b4609bd0d076 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "POST /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59/action" status: 200 len: 24862 microversion: 2.1 time: 0.138692 May 26 14:58:47.786687 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 90/175] 10.222.0.81 () {60 vars in 1278 bytes} [Wed May 26 14:58:47 2021] POST /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59/action => generated 24862 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 14:58:47.791823 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-2fcc02d5-d677-455d-bef2-0323dafc699a tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:58:47.792641 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-2fcc02d5-d677-455d-bef2-0323dafc699a tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] [instance: 396d0570-c547-4549-8fe6-dd156ef64c4b] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:58:47.869349 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-2fcc02d5-d677-455d-bef2-0323dafc699a tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be4bd5c0f2a400da491bae101b48832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515325707f64d58a28f26451b2c74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:58:47.874042 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-242b84c7-a90f-46d9-93a9-e7cab6f354a1 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "POST /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984/action" status: 200 len: 16877 microversion: 2.20 time: 0.143689 May 26 14:58:47.874970 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 86/176] 10.222.0.81 () {62 vars in 1319 bytes} [Wed May 26 14:58:47 2021] POST /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984/action => generated 16877 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 26 14:58:47.878463 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-2fcc02d5-d677-455d-bef2-0323dafc699a tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /compute/v2.1/servers/396d0570-c547-4549-8fe6-dd156ef64c4b" status: 200 len: 1217 microversion: 2.1 time: 0.089262 May 26 14:58:47.878463 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 91/177] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:58:47 2021] GET /compute/v2.1/servers/396d0570-c547-4549-8fe6-dd156ef64c4b => generated 1217 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:58:48.663255 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-fb41c3ee-883c-4c34-8467-60e5baa7e531 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:58:48.663969 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-fb41c3ee-883c-4c34-8467-60e5baa7e531 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] [instance: acc03344-b5df-4277-82e4-c9b3228969ca] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:58:48.676933 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-fb41c3ee-883c-4c34-8467-60e5baa7e531 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:48.676933 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-fb41c3ee-883c-4c34-8467-60e5baa7e531 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:48.677480 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-fb41c3ee-883c-4c34-8467-60e5baa7e531 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:48.678974 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-fb41c3ee-883c-4c34-8467-60e5baa7e531 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:48.797248 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-b406d3cb-0b9f-40ec-96fe-281848b96cac tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:58:48.799362 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-b406d3cb-0b9f-40ec-96fe-281848b96cac tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: a9d8f9a6-bd66-4caa-8662-4bb94655ae59] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:58:48.808375 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-b406d3cb-0b9f-40ec-96fe-281848b96cac tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:48.808833 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-b406d3cb-0b9f-40ec-96fe-281848b96cac tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:48.809812 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-b406d3cb-0b9f-40ec-96fe-281848b96cac tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:48.810461 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-b406d3cb-0b9f-40ec-96fe-281848b96cac tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:48.918956 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-b406d3cb-0b9f-40ec-96fe-281848b96cac tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "POST /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59/action" status: 200 len: 25782 microversion: 2.1 time: 0.125114 May 26 14:58:48.919702 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 92/178] 10.222.0.81 () {60 vars in 1278 bytes} [Wed May 26 14:58:48 2021] POST /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59/action => generated 25782 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 14:58:48.925290 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-c90a87d5-05fa-4d6d-ba04-ba819f76794c tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:58:48.926472 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-c90a87d5-05fa-4d6d-ba04-ba819f76794c tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 598b0e3f-8cf1-451a-80a8-ed7e5dd36984] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:58:48.932533 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-fb41c3ee-883c-4c34-8467-60e5baa7e531 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b167942c895345b186a3eda5c82175b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad2ab2705ca479ab4aaafe7c80de162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:58:48.937365 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-c90a87d5-05fa-4d6d-ba04-ba819f76794c tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:48.938044 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-c90a87d5-05fa-4d6d-ba04-ba819f76794c tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:48.939371 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-c90a87d5-05fa-4d6d-ba04-ba819f76794c tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:48.939812 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-c90a87d5-05fa-4d6d-ba04-ba819f76794c tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:48.943424 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-fb41c3ee-883c-4c34-8467-60e5baa7e531 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /compute/v2.1/servers/acc03344-b5df-4277-82e4-c9b3228969ca" status: 200 len: 1522 microversion: 2.1 time: 0.284189 May 26 14:58:48.944517 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 87/179] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:58:48 2021] GET /compute/v2.1/servers/acc03344-b5df-4277-82e4-c9b3228969ca => generated 1522 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:58:48.949101 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-9d437bc6-01c7-4534-80c7-37bff38d55a6 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:58:48.949825 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-9d437bc6-01c7-4534-80c7-37bff38d55a6 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] [instance: 396d0570-c547-4549-8fe6-dd156ef64c4b] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:58:48.958445 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-9d437bc6-01c7-4534-80c7-37bff38d55a6 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:48.958907 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-9d437bc6-01c7-4534-80c7-37bff38d55a6 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:48.959870 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-9d437bc6-01c7-4534-80c7-37bff38d55a6 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:48.970772 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-9d437bc6-01c7-4534-80c7-37bff38d55a6 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:49.053837 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-c90a87d5-05fa-4d6d-ba04-ba819f76794c tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "POST /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984/action" status: 200 len: 17960 microversion: 2.20 time: 0.132501 May 26 14:58:49.057708 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 93/180] 10.222.0.81 () {62 vars in 1319 bytes} [Wed May 26 14:58:48 2021] POST /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984/action => generated 17960 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 26 14:58:49.079156 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-9d437bc6-01c7-4534-80c7-37bff38d55a6 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be4bd5c0f2a400da491bae101b48832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515325707f64d58a28f26451b2c74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:58:49.090588 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-9d437bc6-01c7-4534-80c7-37bff38d55a6 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /compute/v2.1/servers/396d0570-c547-4549-8fe6-dd156ef64c4b" status: 200 len: 1221 microversion: 2.1 time: 0.144484 May 26 14:58:49.092461 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 88/181] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:58:48 2021] GET /compute/v2.1/servers/396d0570-c547-4549-8fe6-dd156ef64c4b => generated 1221 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:58:49.931452 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-063ccdcf-9685-47d8-b817-e0eeeeacb3ac tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:58:49.932479 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-063ccdcf-9685-47d8-b817-e0eeeeacb3ac tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: a9d8f9a6-bd66-4caa-8662-4bb94655ae59] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:58:49.941167 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-063ccdcf-9685-47d8-b817-e0eeeeacb3ac tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:49.941660 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-063ccdcf-9685-47d8-b817-e0eeeeacb3ac tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:49.942470 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-063ccdcf-9685-47d8-b817-e0eeeeacb3ac tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:49.943102 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-063ccdcf-9685-47d8-b817-e0eeeeacb3ac tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:49.961922 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-b9e41215-3651-4d59-a49f-75e0ec489990 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:58:49.963331 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-b9e41215-3651-4d59-a49f-75e0ec489990 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] [instance: acc03344-b5df-4277-82e4-c9b3228969ca] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:58:49.971770 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-b9e41215-3651-4d59-a49f-75e0ec489990 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:49.972568 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-b9e41215-3651-4d59-a49f-75e0ec489990 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:49.973913 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-b9e41215-3651-4d59-a49f-75e0ec489990 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:49.974582 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-b9e41215-3651-4d59-a49f-75e0ec489990 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:50.052950 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-063ccdcf-9685-47d8-b817-e0eeeeacb3ac tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "POST /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59/action" status: 200 len: 26561 microversion: 2.1 time: 0.125482 May 26 14:58:50.057152 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 94/182] 10.222.0.81 () {60 vars in 1278 bytes} [Wed May 26 14:58:49 2021] POST /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59/action => generated 26561 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 14:58:50.066368 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-7c152f7e-a5f6-435b-813b-376ca1a62e8e tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:58:50.067375 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-7c152f7e-a5f6-435b-813b-376ca1a62e8e tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 598b0e3f-8cf1-451a-80a8-ed7e5dd36984] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:58:50.076211 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-7c152f7e-a5f6-435b-813b-376ca1a62e8e tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:50.077118 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-7c152f7e-a5f6-435b-813b-376ca1a62e8e tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:50.078117 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-7c152f7e-a5f6-435b-813b-376ca1a62e8e tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:50.078559 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-7c152f7e-a5f6-435b-813b-376ca1a62e8e tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:50.183000 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-7c152f7e-a5f6-435b-813b-376ca1a62e8e tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "POST /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984/action" status: 200 len: 19342 microversion: 2.20 time: 0.120999 May 26 14:58:50.183709 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 95/183] 10.222.0.81 () {62 vars in 1319 bytes} [Wed May 26 14:58:50 2021] POST /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984/action => generated 19342 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 26 14:58:50.190658 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-6a686340-0f19-4c61-b30e-877e96567b3d tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:58:50.191717 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-6a686340-0f19-4c61-b30e-877e96567b3d tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] [instance: 396d0570-c547-4549-8fe6-dd156ef64c4b] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:58:50.200428 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-6a686340-0f19-4c61-b30e-877e96567b3d tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:50.200891 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-6a686340-0f19-4c61-b30e-877e96567b3d tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:50.201703 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-6a686340-0f19-4c61-b30e-877e96567b3d tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:50.213194 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-6a686340-0f19-4c61-b30e-877e96567b3d tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:50.301251 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-b9e41215-3651-4d59-a49f-75e0ec489990 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b167942c895345b186a3eda5c82175b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad2ab2705ca479ab4aaafe7c80de162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:58:50.310909 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-b9e41215-3651-4d59-a49f-75e0ec489990 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /compute/v2.1/servers/acc03344-b5df-4277-82e4-c9b3228969ca" status: 200 len: 1522 microversion: 2.1 time: 0.351873 May 26 14:58:50.322991 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 89/184] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:58:49 2021] GET /compute/v2.1/servers/acc03344-b5df-4277-82e4-c9b3228969ca => generated 1522 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:58:50.387867 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-6a686340-0f19-4c61-b30e-877e96567b3d tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be4bd5c0f2a400da491bae101b48832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515325707f64d58a28f26451b2c74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:58:50.397572 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-6a686340-0f19-4c61-b30e-877e96567b3d tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /compute/v2.1/servers/396d0570-c547-4549-8fe6-dd156ef64c4b" status: 200 len: 1277 microversion: 2.1 time: 0.212434 May 26 14:58:50.398163 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 96/185] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:58:50 2021] GET /compute/v2.1/servers/396d0570-c547-4549-8fe6-dd156ef64c4b => generated 1277 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:58:51.065174 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-ac7c11b5-8c70-41d2-89f1-d0f541227855 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:58:51.066299 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-ac7c11b5-8c70-41d2-89f1-d0f541227855 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: a9d8f9a6-bd66-4caa-8662-4bb94655ae59] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:58:51.074668 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-ac7c11b5-8c70-41d2-89f1-d0f541227855 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:51.077503 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-ac7c11b5-8c70-41d2-89f1-d0f541227855 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:51.077503 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-ac7c11b5-8c70-41d2-89f1-d0f541227855 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:51.077503 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-ac7c11b5-8c70-41d2-89f1-d0f541227855 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:51.200095 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-8b0b478a-52e9-4427-b3d9-4086e10e0460 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:58:51.209340 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-ac7c11b5-8c70-41d2-89f1-d0f541227855 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "POST /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59/action" status: 200 len: 27228 microversion: 2.1 time: 0.148108 May 26 14:58:51.211267 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 90/186] 10.222.0.81 () {60 vars in 1278 bytes} [Wed May 26 14:58:51 2021] POST /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59/action => generated 27228 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 14:58:51.212920 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-8b0b478a-52e9-4427-b3d9-4086e10e0460 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 598b0e3f-8cf1-451a-80a8-ed7e5dd36984] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:58:51.262876 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-8b0b478a-52e9-4427-b3d9-4086e10e0460 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:51.270894 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-8b0b478a-52e9-4427-b3d9-4086e10e0460 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:51.271774 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-8b0b478a-52e9-4427-b3d9-4086e10e0460 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:51.272237 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-8b0b478a-52e9-4427-b3d9-4086e10e0460 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:51.330537 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-00dc0e4c-9c91-49b9-93c7-c19f60eba86a tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:58:51.332071 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-00dc0e4c-9c91-49b9-93c7-c19f60eba86a tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] [instance: acc03344-b5df-4277-82e4-c9b3228969ca] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:58:51.353294 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-00dc0e4c-9c91-49b9-93c7-c19f60eba86a tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:51.362044 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-00dc0e4c-9c91-49b9-93c7-c19f60eba86a tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:51.363178 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-00dc0e4c-9c91-49b9-93c7-c19f60eba86a tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:51.363785 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-00dc0e4c-9c91-49b9-93c7-c19f60eba86a tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:51.439597 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-8b0b478a-52e9-4427-b3d9-4086e10e0460 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "POST /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984/action" status: 200 len: 21966 microversion: 2.20 time: 0.245112 May 26 14:58:51.444992 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 97/187] 10.222.0.81 () {62 vars in 1319 bytes} [Wed May 26 14:58:51 2021] POST /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984/action => generated 21966 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 26 14:58:51.453115 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-08cde1e0-04e8-4f47-b9c7-927b27ee4002 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:58:51.454092 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-08cde1e0-04e8-4f47-b9c7-927b27ee4002 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] [instance: 396d0570-c547-4549-8fe6-dd156ef64c4b] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:58:51.468420 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-08cde1e0-04e8-4f47-b9c7-927b27ee4002 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:51.469112 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-08cde1e0-04e8-4f47-b9c7-927b27ee4002 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:51.477376 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-08cde1e0-04e8-4f47-b9c7-927b27ee4002 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:51.497802 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-08cde1e0-04e8-4f47-b9c7-927b27ee4002 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:51.917043 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-00dc0e4c-9c91-49b9-93c7-c19f60eba86a tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b167942c895345b186a3eda5c82175b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad2ab2705ca479ab4aaafe7c80de162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:58:51.926178 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-00dc0e4c-9c91-49b9-93c7-c19f60eba86a tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /compute/v2.1/servers/acc03344-b5df-4277-82e4-c9b3228969ca" status: 200 len: 1522 microversion: 2.1 time: 0.600923 May 26 14:58:51.927035 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 91/188] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:58:51 2021] GET /compute/v2.1/servers/acc03344-b5df-4277-82e4-c9b3228969ca => generated 1522 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:58:52.222870 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-6c9eec7d-3849-4923-9204-5809b2422a85 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:58:52.223794 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-6c9eec7d-3849-4923-9204-5809b2422a85 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: a9d8f9a6-bd66-4caa-8662-4bb94655ae59] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:58:52.231919 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-08cde1e0-04e8-4f47-b9c7-927b27ee4002 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be4bd5c0f2a400da491bae101b48832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515325707f64d58a28f26451b2c74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:58:52.232973 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-6c9eec7d-3849-4923-9204-5809b2422a85 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:52.233434 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-6c9eec7d-3849-4923-9204-5809b2422a85 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:52.234254 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-6c9eec7d-3849-4923-9204-5809b2422a85 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:52.235813 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-6c9eec7d-3849-4923-9204-5809b2422a85 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:52.241186 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-08cde1e0-04e8-4f47-b9c7-927b27ee4002 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /compute/v2.1/servers/396d0570-c547-4549-8fe6-dd156ef64c4b" status: 200 len: 1317 microversion: 2.1 time: 0.794148 May 26 14:58:52.241870 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 98/189] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:58:51 2021] GET /compute/v2.1/servers/396d0570-c547-4549-8fe6-dd156ef64c4b => generated 1317 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:58:52.346995 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-6c9eec7d-3849-4923-9204-5809b2422a85 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "POST /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59/action" status: 200 len: 27600 microversion: 2.1 time: 0.125878 May 26 14:58:52.349036 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 92/190] 10.222.0.81 () {60 vars in 1278 bytes} [Wed May 26 14:58:52 2021] POST /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59/action => generated 27600 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 26 14:58:52.452301 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-23cfe33a-2003-4d5c-9687-a0a4512a481e tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:58:52.453534 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-23cfe33a-2003-4d5c-9687-a0a4512a481e tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 598b0e3f-8cf1-451a-80a8-ed7e5dd36984] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:58:52.464696 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-23cfe33a-2003-4d5c-9687-a0a4512a481e tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:52.465967 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-23cfe33a-2003-4d5c-9687-a0a4512a481e tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:52.467443 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-23cfe33a-2003-4d5c-9687-a0a4512a481e tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:52.467908 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-23cfe33a-2003-4d5c-9687-a0a4512a481e tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:52.590976 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-23cfe33a-2003-4d5c-9687-a0a4512a481e tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "POST /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984/action" status: 200 len: 23219 microversion: 2.20 time: 0.142305 May 26 14:58:52.591608 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 99/191] 10.222.0.81 () {62 vars in 1319 bytes} [Wed May 26 14:58:52 2021] POST /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984/action => generated 23219 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 26 14:58:52.945628 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-471bd7e6-53ab-47d3-8395-adda563bfbb8 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:58:52.946852 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-471bd7e6-53ab-47d3-8395-adda563bfbb8 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] [instance: acc03344-b5df-4277-82e4-c9b3228969ca] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:58:52.955745 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-471bd7e6-53ab-47d3-8395-adda563bfbb8 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:52.956209 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-471bd7e6-53ab-47d3-8395-adda563bfbb8 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:52.957346 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-471bd7e6-53ab-47d3-8395-adda563bfbb8 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:52.958010 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-471bd7e6-53ab-47d3-8395-adda563bfbb8 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:53.208214 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [req-842ee0a0-1c91-4eb4-a5b9-a9c4bef6563c req-42fa73a8-6721-4b12-b9f6-fea2dd03fd68 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "396d0570-c547-4549-8fe6-dd156ef64c4b", "tag": "5969b659-5456-4b6d-84cd-6a9fdbac70df"}]} {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:58:53.212422 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 14:58:53.212422 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: warnings.warn(msg) May 26 14:58:53.226110 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [req-842ee0a0-1c91-4eb4-a5b9-a9c4bef6563c req-42fa73a8-6721-4b12-b9f6-fea2dd03fd68 service nova] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:53.229388 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [req-842ee0a0-1c91-4eb4-a5b9-a9c4bef6563c req-42fa73a8-6721-4b12-b9f6-fea2dd03fd68 service nova] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:53.242256 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-471bd7e6-53ab-47d3-8395-adda563bfbb8 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b167942c895345b186a3eda5c82175b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad2ab2705ca479ab4aaafe7c80de162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:58:53.251642 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-471bd7e6-53ab-47d3-8395-adda563bfbb8 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /compute/v2.1/servers/acc03344-b5df-4277-82e4-c9b3228969ca" status: 200 len: 1522 microversion: 2.1 time: 0.311123 May 26 14:58:53.257255 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.compute.server_external_events [req-842ee0a0-1c91-4eb4-a5b9-a9c4bef6563c req-42fa73a8-6721-4b12-b9f6-fea2dd03fd68 service nova] Creating event network-changed:5969b659-5456-4b6d-84cd-6a9fdbac70df for instance 396d0570-c547-4549-8fe6-dd156ef64c4b on hv-cinder-78414 May 26 14:58:53.262981 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 93/192] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:58:52 2021] GET /compute/v2.1/servers/acc03344-b5df-4277-82e4-c9b3228969ca => generated 1522 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:58:53.265170 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [req-842ee0a0-1c91-4eb4-a5b9-a9c4bef6563c req-42fa73a8-6721-4b12-b9f6-fea2dd03fd68 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062148 May 26 14:58:53.269810 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 100/193] 10.222.0.81 () {64 vars in 1318 bytes} [Wed May 26 14:58:53 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 14:58:53.270034 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-17c8a363-12cb-421d-81f1-5bf894ab902c tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:58:53.270515 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-17c8a363-12cb-421d-81f1-5bf894ab902c tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] [instance: 396d0570-c547-4549-8fe6-dd156ef64c4b] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:58:53.291285 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-17c8a363-12cb-421d-81f1-5bf894ab902c tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:53.291860 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-17c8a363-12cb-421d-81f1-5bf894ab902c tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:53.292784 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-17c8a363-12cb-421d-81f1-5bf894ab902c tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:53.293335 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-17c8a363-12cb-421d-81f1-5bf894ab902c tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:53.358696 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-ecc24d66-cc55-4a1d-8f6e-759021aaeca6 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:58:53.359986 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-ecc24d66-cc55-4a1d-8f6e-759021aaeca6 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: a9d8f9a6-bd66-4caa-8662-4bb94655ae59] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:58:53.373472 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-ecc24d66-cc55-4a1d-8f6e-759021aaeca6 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:53.382208 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-ecc24d66-cc55-4a1d-8f6e-759021aaeca6 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:53.383354 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-ecc24d66-cc55-4a1d-8f6e-759021aaeca6 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:53.383809 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-ecc24d66-cc55-4a1d-8f6e-759021aaeca6 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:53.543287 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-ecc24d66-cc55-4a1d-8f6e-759021aaeca6 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "POST /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59/action" status: 200 len: 27924 microversion: 2.1 time: 0.188116 May 26 14:58:53.544971 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 101/194] 10.222.0.81 () {60 vars in 1278 bytes} [Wed May 26 14:58:53 2021] POST /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59/action => generated 27924 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 26 14:58:53.605162 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-0333cc28-08ac-4746-b81c-91a530841a7a tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:58:53.608224 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-0333cc28-08ac-4746-b81c-91a530841a7a tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 598b0e3f-8cf1-451a-80a8-ed7e5dd36984] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:58:53.631491 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-17c8a363-12cb-421d-81f1-5bf894ab902c tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be4bd5c0f2a400da491bae101b48832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515325707f64d58a28f26451b2c74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:58:53.639729 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-0333cc28-08ac-4746-b81c-91a530841a7a tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:53.643627 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-17c8a363-12cb-421d-81f1-5bf894ab902c tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /compute/v2.1/servers/396d0570-c547-4549-8fe6-dd156ef64c4b" status: 200 len: 1317 microversion: 2.1 time: 0.379040 May 26 14:58:53.644280 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-0333cc28-08ac-4746-b81c-91a530841a7a tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:53.644917 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 94/195] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:58:53 2021] GET /compute/v2.1/servers/396d0570-c547-4549-8fe6-dd156ef64c4b => generated 1317 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:58:53.645643 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-0333cc28-08ac-4746-b81c-91a530841a7a tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:53.646522 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-0333cc28-08ac-4746-b81c-91a530841a7a tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:53.760166 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-0333cc28-08ac-4746-b81c-91a530841a7a tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "POST /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984/action" status: 200 len: 24332 microversion: 2.20 time: 0.161647 May 26 14:58:53.761233 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 102/196] 10.222.0.81 () {62 vars in 1319 bytes} [Wed May 26 14:58:53 2021] POST /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984/action => generated 24332 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 26 14:58:54.269823 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-1648b945-5237-4443-8821-8903984b32e9 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:58:54.270464 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-1648b945-5237-4443-8821-8903984b32e9 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] [instance: acc03344-b5df-4277-82e4-c9b3228969ca] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:58:54.279189 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-1648b945-5237-4443-8821-8903984b32e9 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:54.279953 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-1648b945-5237-4443-8821-8903984b32e9 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:54.280965 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-1648b945-5237-4443-8821-8903984b32e9 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:54.281645 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-1648b945-5237-4443-8821-8903984b32e9 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:54.503256 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-1648b945-5237-4443-8821-8903984b32e9 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b167942c895345b186a3eda5c82175b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad2ab2705ca479ab4aaafe7c80de162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:58:54.512687 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-1648b945-5237-4443-8821-8903984b32e9 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /compute/v2.1/servers/acc03344-b5df-4277-82e4-c9b3228969ca" status: 200 len: 1522 microversion: 2.1 time: 0.246845 May 26 14:58:54.514117 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 95/197] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:58:54 2021] GET /compute/v2.1/servers/acc03344-b5df-4277-82e4-c9b3228969ca => generated 1522 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:58:54.556357 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-f31b0da3-fae3-4f7b-b87e-cfa3ab3f7ea5 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:58:54.558100 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-f31b0da3-fae3-4f7b-b87e-cfa3ab3f7ea5 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: a9d8f9a6-bd66-4caa-8662-4bb94655ae59] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:58:54.566998 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-f31b0da3-fae3-4f7b-b87e-cfa3ab3f7ea5 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:54.567772 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-f31b0da3-fae3-4f7b-b87e-cfa3ab3f7ea5 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:54.568781 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-f31b0da3-fae3-4f7b-b87e-cfa3ab3f7ea5 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:54.569437 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-f31b0da3-fae3-4f7b-b87e-cfa3ab3f7ea5 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:54.661384 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-c809eb71-f0b2-4e6b-ba8f-6ea0b1477dbb tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:58:54.662081 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-c809eb71-f0b2-4e6b-ba8f-6ea0b1477dbb tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] [instance: 396d0570-c547-4549-8fe6-dd156ef64c4b] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:58:54.670014 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-c809eb71-f0b2-4e6b-ba8f-6ea0b1477dbb tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:54.670552 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-c809eb71-f0b2-4e6b-ba8f-6ea0b1477dbb tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:54.671566 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-c809eb71-f0b2-4e6b-ba8f-6ea0b1477dbb tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:54.672076 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-c809eb71-f0b2-4e6b-ba8f-6ea0b1477dbb tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:54.690647 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-f31b0da3-fae3-4f7b-b87e-cfa3ab3f7ea5 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "POST /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59/action" status: 200 len: 28179 microversion: 2.1 time: 0.138217 May 26 14:58:54.691731 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 103/198] 10.222.0.81 () {60 vars in 1278 bytes} [Wed May 26 14:58:54 2021] POST /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59/action => generated 28179 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 26 14:58:54.773928 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-40bdc100-3716-4919-9571-3020413f184b tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:58:54.775251 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-40bdc100-3716-4919-9571-3020413f184b tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 598b0e3f-8cf1-451a-80a8-ed7e5dd36984] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:58:54.788769 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-40bdc100-3716-4919-9571-3020413f184b tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:54.789753 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-40bdc100-3716-4919-9571-3020413f184b tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:54.791377 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-40bdc100-3716-4919-9571-3020413f184b tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:54.791979 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-40bdc100-3716-4919-9571-3020413f184b tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:54.913093 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-c809eb71-f0b2-4e6b-ba8f-6ea0b1477dbb tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be4bd5c0f2a400da491bae101b48832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515325707f64d58a28f26451b2c74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:58:54.922010 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-c809eb71-f0b2-4e6b-ba8f-6ea0b1477dbb tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /compute/v2.1/servers/396d0570-c547-4549-8fe6-dd156ef64c4b" status: 200 len: 1317 microversion: 2.1 time: 0.264524 May 26 14:58:54.922565 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 96/199] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:58:54 2021] GET /compute/v2.1/servers/396d0570-c547-4549-8fe6-dd156ef64c4b => generated 1317 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 14:58:54.943752 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-40bdc100-3716-4919-9571-3020413f184b tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "POST /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984/action" status: 200 len: 25148 microversion: 2.20 time: 0.174827 May 26 14:58:54.945285 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 104/200] 10.222.0.81 () {62 vars in 1319 bytes} [Wed May 26 14:58:54 2021] POST /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984/action => generated 25148 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 26 14:58:55.533068 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-7af93128-4556-494f-b8e5-c0460a0c6c8f tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:58:55.534205 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-7af93128-4556-494f-b8e5-c0460a0c6c8f tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] [instance: acc03344-b5df-4277-82e4-c9b3228969ca] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:58:55.545518 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-7af93128-4556-494f-b8e5-c0460a0c6c8f tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:55.546089 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-7af93128-4556-494f-b8e5-c0460a0c6c8f tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:55.546957 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-7af93128-4556-494f-b8e5-c0460a0c6c8f tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:55.547491 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-7af93128-4556-494f-b8e5-c0460a0c6c8f tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:55.703631 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-5808decd-462b-4ecf-90d5-de316e2f08a0 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:58:55.706478 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-5808decd-462b-4ecf-90d5-de316e2f08a0 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: a9d8f9a6-bd66-4caa-8662-4bb94655ae59] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:58:55.716321 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-5808decd-462b-4ecf-90d5-de316e2f08a0 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:55.717114 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-5808decd-462b-4ecf-90d5-de316e2f08a0 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:55.718466 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-5808decd-462b-4ecf-90d5-de316e2f08a0 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:55.719141 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-5808decd-462b-4ecf-90d5-de316e2f08a0 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:55.774957 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-7af93128-4556-494f-b8e5-c0460a0c6c8f tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b167942c895345b186a3eda5c82175b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad2ab2705ca479ab4aaafe7c80de162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:58:55.784858 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-7af93128-4556-494f-b8e5-c0460a0c6c8f tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /compute/v2.1/servers/acc03344-b5df-4277-82e4-c9b3228969ca" status: 200 len: 1522 microversion: 2.1 time: 0.255746 May 26 14:58:55.796666 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 97/201] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:58:55 2021] GET /compute/v2.1/servers/acc03344-b5df-4277-82e4-c9b3228969ca => generated 1522 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:58:55.853940 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-5808decd-462b-4ecf-90d5-de316e2f08a0 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "POST /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59/action" status: 200 len: 28179 microversion: 2.1 time: 0.154639 May 26 14:58:55.857911 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 105/202] 10.222.0.81 () {60 vars in 1278 bytes} [Wed May 26 14:58:55 2021] POST /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59/action => generated 28179 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 26 14:58:55.943446 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-341fa731-fe13-46c7-a7a7-6a0e6c3473be tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:58:55.944112 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-341fa731-fe13-46c7-a7a7-6a0e6c3473be tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] [instance: 396d0570-c547-4549-8fe6-dd156ef64c4b] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:58:55.951638 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-341fa731-fe13-46c7-a7a7-6a0e6c3473be tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:55.952250 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-341fa731-fe13-46c7-a7a7-6a0e6c3473be tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:55.953466 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-341fa731-fe13-46c7-a7a7-6a0e6c3473be tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:55.953933 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-341fa731-fe13-46c7-a7a7-6a0e6c3473be tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:55.957948 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-9f14f46f-4c64-4c72-9a1f-efa5caa3c413 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:58:55.958998 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-9f14f46f-4c64-4c72-9a1f-efa5caa3c413 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 598b0e3f-8cf1-451a-80a8-ed7e5dd36984] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:58:55.968049 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-9f14f46f-4c64-4c72-9a1f-efa5caa3c413 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:55.968509 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-9f14f46f-4c64-4c72-9a1f-efa5caa3c413 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:55.969301 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-9f14f46f-4c64-4c72-9a1f-efa5caa3c413 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:55.970373 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-9f14f46f-4c64-4c72-9a1f-efa5caa3c413 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:56.085915 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-9f14f46f-4c64-4c72-9a1f-efa5caa3c413 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "POST /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984/action" status: 200 len: 26176 microversion: 2.20 time: 0.133539 May 26 14:58:56.086637 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 106/203] 10.222.0.81 () {62 vars in 1319 bytes} [Wed May 26 14:58:55 2021] POST /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984/action => generated 26176 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 26 14:58:56.184285 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-341fa731-fe13-46c7-a7a7-6a0e6c3473be tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be4bd5c0f2a400da491bae101b48832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515325707f64d58a28f26451b2c74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:58:56.192886 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-341fa731-fe13-46c7-a7a7-6a0e6c3473be tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /compute/v2.1/servers/396d0570-c547-4549-8fe6-dd156ef64c4b" status: 200 len: 1317 microversion: 2.1 time: 0.254292 May 26 14:58:56.193457 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 98/204] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:58:55 2021] GET /compute/v2.1/servers/396d0570-c547-4549-8fe6-dd156ef64c4b => generated 1317 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:58:56.807080 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-152171c0-9da5-46d1-9ea2-dca086e9c23a tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:58:56.808969 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-152171c0-9da5-46d1-9ea2-dca086e9c23a tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] [instance: acc03344-b5df-4277-82e4-c9b3228969ca] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:58:56.826409 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-152171c0-9da5-46d1-9ea2-dca086e9c23a tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:56.826409 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-152171c0-9da5-46d1-9ea2-dca086e9c23a tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:56.826409 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-152171c0-9da5-46d1-9ea2-dca086e9c23a tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:56.826409 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-152171c0-9da5-46d1-9ea2-dca086e9c23a tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:56.866838 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-aefc527a-e19b-4fb1-a14b-064abf8e2677 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:58:56.868200 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-aefc527a-e19b-4fb1-a14b-064abf8e2677 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: a9d8f9a6-bd66-4caa-8662-4bb94655ae59] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:58:56.881299 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-aefc527a-e19b-4fb1-a14b-064abf8e2677 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:56.881788 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-aefc527a-e19b-4fb1-a14b-064abf8e2677 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:56.888439 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-aefc527a-e19b-4fb1-a14b-064abf8e2677 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:56.889002 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-aefc527a-e19b-4fb1-a14b-064abf8e2677 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:57.016612 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-aefc527a-e19b-4fb1-a14b-064abf8e2677 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "POST /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59/action" status: 200 len: 28468 microversion: 2.1 time: 0.153521 May 26 14:58:57.018243 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 99/205] 10.222.0.81 () {60 vars in 1278 bytes} [Wed May 26 14:58:56 2021] POST /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59/action => generated 28468 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 14:58:57.099155 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-1f1f9da7-a1a5-4b10-9b0a-93a6905ed0e8 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:58:57.100516 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-1f1f9da7-a1a5-4b10-9b0a-93a6905ed0e8 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 598b0e3f-8cf1-451a-80a8-ed7e5dd36984] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:58:57.108764 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-1f1f9da7-a1a5-4b10-9b0a-93a6905ed0e8 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:57.109301 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-1f1f9da7-a1a5-4b10-9b0a-93a6905ed0e8 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:57.110218 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-1f1f9da7-a1a5-4b10-9b0a-93a6905ed0e8 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:57.112188 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-1f1f9da7-a1a5-4b10-9b0a-93a6905ed0e8 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:57.233773 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-1f1f9da7-a1a5-4b10-9b0a-93a6905ed0e8 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "POST /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984/action" status: 200 len: 27001 microversion: 2.20 time: 0.138628 May 26 14:58:57.234507 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 100/206] 10.222.0.81 () {62 vars in 1319 bytes} [Wed May 26 14:58:57 2021] POST /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984/action => generated 27001 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 26 14:58:57.241669 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-b555b4ac-4314-40a4-b970-36a1d1f7882a tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:58:57.242688 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-b555b4ac-4314-40a4-b970-36a1d1f7882a tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] [instance: 396d0570-c547-4549-8fe6-dd156ef64c4b] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:58:57.252207 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-152171c0-9da5-46d1-9ea2-dca086e9c23a tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b167942c895345b186a3eda5c82175b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad2ab2705ca479ab4aaafe7c80de162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:58:57.252622 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-b555b4ac-4314-40a4-b970-36a1d1f7882a tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:57.253137 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-b555b4ac-4314-40a4-b970-36a1d1f7882a tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:57.262594 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-152171c0-9da5-46d1-9ea2-dca086e9c23a tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /compute/v2.1/servers/acc03344-b5df-4277-82e4-c9b3228969ca" status: 200 len: 1522 microversion: 2.1 time: 0.462976 May 26 14:58:57.262805 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-b555b4ac-4314-40a4-b970-36a1d1f7882a tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:57.263074 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 107/207] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:58:56 2021] GET /compute/v2.1/servers/acc03344-b5df-4277-82e4-c9b3228969ca => generated 1522 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:58:57.263615 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-b555b4ac-4314-40a4-b970-36a1d1f7882a tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:57.464297 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-b555b4ac-4314-40a4-b970-36a1d1f7882a tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be4bd5c0f2a400da491bae101b48832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515325707f64d58a28f26451b2c74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:58:57.482608 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-b555b4ac-4314-40a4-b970-36a1d1f7882a tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /compute/v2.1/servers/396d0570-c547-4549-8fe6-dd156ef64c4b" status: 200 len: 1317 microversion: 2.1 time: 0.243974 May 26 14:58:57.482608 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 101/208] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:58:57 2021] GET /compute/v2.1/servers/396d0570-c547-4549-8fe6-dd156ef64c4b => generated 1317 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:58:58.108767 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-033ae045-e8d7-44c2-991f-28cdc1eba826 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:58:58.108767 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-033ae045-e8d7-44c2-991f-28cdc1eba826 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: a9d8f9a6-bd66-4caa-8662-4bb94655ae59] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:58:58.108767 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-033ae045-e8d7-44c2-991f-28cdc1eba826 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:58.108767 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-033ae045-e8d7-44c2-991f-28cdc1eba826 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:58.109971 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-033ae045-e8d7-44c2-991f-28cdc1eba826 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:58.109971 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-033ae045-e8d7-44c2-991f-28cdc1eba826 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:58.147226 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-033ae045-e8d7-44c2-991f-28cdc1eba826 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "POST /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59/action" status: 200 len: 28468 microversion: 2.1 time: 0.122053 May 26 14:58:58.153928 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 108/209] 10.222.0.81 () {60 vars in 1278 bytes} [Wed May 26 14:58:58 2021] POST /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59/action => generated 28468 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 14:58:58.254372 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-abe1e63d-24af-4514-9f87-8980728cb538 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:58:58.254372 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-abe1e63d-24af-4514-9f87-8980728cb538 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 598b0e3f-8cf1-451a-80a8-ed7e5dd36984] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:58:58.256097 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-abe1e63d-24af-4514-9f87-8980728cb538 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:58.256558 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-abe1e63d-24af-4514-9f87-8980728cb538 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:58.257343 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-abe1e63d-24af-4514-9f87-8980728cb538 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:58.257849 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-abe1e63d-24af-4514-9f87-8980728cb538 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:58.280593 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-c3761c64-667d-456e-a406-bc2a08984ed6 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:58:58.294317 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-c3761c64-667d-456e-a406-bc2a08984ed6 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] [instance: acc03344-b5df-4277-82e4-c9b3228969ca] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:58:58.294317 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-c3761c64-667d-456e-a406-bc2a08984ed6 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:58.294317 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-c3761c64-667d-456e-a406-bc2a08984ed6 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:58.294317 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-c3761c64-667d-456e-a406-bc2a08984ed6 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:58.294808 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-c3761c64-667d-456e-a406-bc2a08984ed6 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:58.409561 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-abe1e63d-24af-4514-9f87-8980728cb538 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "POST /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984/action" status: 200 len: 27493 microversion: 2.20 time: 0.126437 May 26 14:58:58.409561 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 102/210] 10.222.0.81 () {62 vars in 1319 bytes} [Wed May 26 14:58:58 2021] POST /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984/action => generated 27493 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 26 14:58:58.500407 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-1dfefebb-6b26-4c7b-a60c-a1efa3072500 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:58:58.501979 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-1dfefebb-6b26-4c7b-a60c-a1efa3072500 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] [instance: 396d0570-c547-4549-8fe6-dd156ef64c4b] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:58:58.512495 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-1dfefebb-6b26-4c7b-a60c-a1efa3072500 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:58.517441 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-1dfefebb-6b26-4c7b-a60c-a1efa3072500 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:58.517441 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-1dfefebb-6b26-4c7b-a60c-a1efa3072500 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:58.517441 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-1dfefebb-6b26-4c7b-a60c-a1efa3072500 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:58.517842 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-c3761c64-667d-456e-a406-bc2a08984ed6 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b167942c895345b186a3eda5c82175b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad2ab2705ca479ab4aaafe7c80de162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:58:58.525753 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-c3761c64-667d-456e-a406-bc2a08984ed6 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /compute/v2.1/servers/acc03344-b5df-4277-82e4-c9b3228969ca" status: 200 len: 1522 microversion: 2.1 time: 0.249899 May 26 14:58:58.527365 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 109/211] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:58:58 2021] GET /compute/v2.1/servers/acc03344-b5df-4277-82e4-c9b3228969ca => generated 1522 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 14:58:58.809293 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-1dfefebb-6b26-4c7b-a60c-a1efa3072500 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be4bd5c0f2a400da491bae101b48832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515325707f64d58a28f26451b2c74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:58:58.817994 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-1dfefebb-6b26-4c7b-a60c-a1efa3072500 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /compute/v2.1/servers/396d0570-c547-4549-8fe6-dd156ef64c4b" status: 200 len: 1317 microversion: 2.1 time: 0.322831 May 26 14:58:58.818706 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 103/212] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:58:58 2021] GET /compute/v2.1/servers/396d0570-c547-4549-8fe6-dd156ef64c4b => generated 1317 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 14:58:59.165564 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-8343ba6a-d657-4633-b56e-cc3cb47c3ccb tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:58:59.166483 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-8343ba6a-d657-4633-b56e-cc3cb47c3ccb tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: a9d8f9a6-bd66-4caa-8662-4bb94655ae59] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:58:59.181102 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-8343ba6a-d657-4633-b56e-cc3cb47c3ccb tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:59.181510 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-8343ba6a-d657-4633-b56e-cc3cb47c3ccb tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:59.184166 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-8343ba6a-d657-4633-b56e-cc3cb47c3ccb tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:59.184631 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-8343ba6a-d657-4633-b56e-cc3cb47c3ccb tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:59.411153 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-c4166c16-d658-45dd-9e15-475987bd5625 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:58:59.412645 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-c4166c16-d658-45dd-9e15-475987bd5625 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 598b0e3f-8cf1-451a-80a8-ed7e5dd36984] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:58:59.421851 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-c4166c16-d658-45dd-9e15-475987bd5625 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:59.422279 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-c4166c16-d658-45dd-9e15-475987bd5625 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:59.423073 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-c4166c16-d658-45dd-9e15-475987bd5625 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:59.423608 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-c4166c16-d658-45dd-9e15-475987bd5625 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:59.740372 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-8343ba6a-d657-4633-b56e-cc3cb47c3ccb tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "POST /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59/action" status: 200 len: 28636 microversion: 2.1 time: 0.579781 May 26 14:58:59.744901 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-c4166c16-d658-45dd-9e15-475987bd5625 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "POST /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984/action" status: 200 len: 27910 microversion: 2.20 time: 0.338385 May 26 14:58:59.746106 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 110/213] 10.222.0.81 () {60 vars in 1278 bytes} [Wed May 26 14:58:59 2021] POST /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59/action => generated 28636 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 14:58:59.750670 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 104/214] 10.222.0.81 () {62 vars in 1319 bytes} [Wed May 26 14:58:59 2021] POST /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984/action => generated 27910 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 26 14:58:59.753113 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-5ac1d926-2190-4379-a729-6ac112cb1c4c tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:58:59.754126 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-5ac1d926-2190-4379-a729-6ac112cb1c4c tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] [instance: acc03344-b5df-4277-82e4-c9b3228969ca] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:58:59.763938 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-5ac1d926-2190-4379-a729-6ac112cb1c4c tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:59.764586 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-5ac1d926-2190-4379-a729-6ac112cb1c4c tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:59.765745 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-5ac1d926-2190-4379-a729-6ac112cb1c4c tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:59.766294 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-5ac1d926-2190-4379-a729-6ac112cb1c4c tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:59.836132 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-bbb48355-133d-4c0c-b370-410a5f376ee3 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:58:59.836979 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-bbb48355-133d-4c0c-b370-410a5f376ee3 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] [instance: 396d0570-c547-4549-8fe6-dd156ef64c4b] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:58:59.845467 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-bbb48355-133d-4c0c-b370-410a5f376ee3 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:59.846040 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-bbb48355-133d-4c0c-b370-410a5f376ee3 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:59.846921 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-bbb48355-133d-4c0c-b370-410a5f376ee3 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:58:59.847686 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-bbb48355-133d-4c0c-b370-410a5f376ee3 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:58:59.980424 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-5ac1d926-2190-4379-a729-6ac112cb1c4c tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b167942c895345b186a3eda5c82175b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad2ab2705ca479ab4aaafe7c80de162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:58:59.990172 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-5ac1d926-2190-4379-a729-6ac112cb1c4c tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /compute/v2.1/servers/acc03344-b5df-4277-82e4-c9b3228969ca" status: 200 len: 1522 microversion: 2.1 time: 0.242313 May 26 14:58:59.991092 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 111/215] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:58:59 2021] GET /compute/v2.1/servers/acc03344-b5df-4277-82e4-c9b3228969ca => generated 1522 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:59:00.071159 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-bbb48355-133d-4c0c-b370-410a5f376ee3 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be4bd5c0f2a400da491bae101b48832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515325707f64d58a28f26451b2c74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:59:00.079420 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-bbb48355-133d-4c0c-b370-410a5f376ee3 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /compute/v2.1/servers/396d0570-c547-4549-8fe6-dd156ef64c4b" status: 200 len: 1317 microversion: 2.1 time: 0.247504 May 26 14:59:00.079957 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 105/216] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:58:59 2021] GET /compute/v2.1/servers/396d0570-c547-4549-8fe6-dd156ef64c4b => generated 1317 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 14:59:00.756819 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-706f6b55-8518-4679-9a8d-5a77d17e9a2d tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:59:00.758780 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-5241c66c-cf15-430a-83d7-1e5e992eca5e tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:59:00.759727 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-5241c66c-cf15-430a-83d7-1e5e992eca5e tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: a9d8f9a6-bd66-4caa-8662-4bb94655ae59] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:00.765382 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-706f6b55-8518-4679-9a8d-5a77d17e9a2d tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 598b0e3f-8cf1-451a-80a8-ed7e5dd36984] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:00.773898 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-5241c66c-cf15-430a-83d7-1e5e992eca5e tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:00.774057 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-706f6b55-8518-4679-9a8d-5a77d17e9a2d tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:00.774419 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-706f6b55-8518-4679-9a8d-5a77d17e9a2d tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:00.774683 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-5241c66c-cf15-430a-83d7-1e5e992eca5e tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:00.775214 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-706f6b55-8518-4679-9a8d-5a77d17e9a2d tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:00.775482 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-5241c66c-cf15-430a-83d7-1e5e992eca5e tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:00.775662 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-706f6b55-8518-4679-9a8d-5a77d17e9a2d tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:00.775929 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-5241c66c-cf15-430a-83d7-1e5e992eca5e tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:00.881526 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-706f6b55-8518-4679-9a8d-5a77d17e9a2d tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "POST /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984/action" status: 200 len: 28204 microversion: 2.20 time: 0.128267 May 26 14:59:00.882287 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 106/217] 10.222.0.81 () {62 vars in 1319 bytes} [Wed May 26 14:59:00 2021] POST /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984/action => generated 28204 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 26 14:59:00.896447 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-5241c66c-cf15-430a-83d7-1e5e992eca5e tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "POST /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59/action" status: 200 len: 28636 microversion: 2.1 time: 0.147779 May 26 14:59:00.897092 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 112/218] 10.222.0.81 () {60 vars in 1278 bytes} [Wed May 26 14:59:00 2021] POST /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59/action => generated 28636 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 14:59:01.009185 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-fb313a10-f13c-4887-a1e0-1cb8c2283ab0 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:59:01.009982 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-fb313a10-f13c-4887-a1e0-1cb8c2283ab0 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] [instance: acc03344-b5df-4277-82e4-c9b3228969ca] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:01.018483 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-fb313a10-f13c-4887-a1e0-1cb8c2283ab0 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:01.019079 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-fb313a10-f13c-4887-a1e0-1cb8c2283ab0 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:01.020125 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-fb313a10-f13c-4887-a1e0-1cb8c2283ab0 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:01.020716 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-fb313a10-f13c-4887-a1e0-1cb8c2283ab0 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:01.097965 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-7b2cb281-2975-4994-827f-954042adb480 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:59:01.098666 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-7b2cb281-2975-4994-827f-954042adb480 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] [instance: 396d0570-c547-4549-8fe6-dd156ef64c4b] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:01.106612 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-7b2cb281-2975-4994-827f-954042adb480 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:01.107067 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-7b2cb281-2975-4994-827f-954042adb480 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:01.107847 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-7b2cb281-2975-4994-827f-954042adb480 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:01.108289 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-7b2cb281-2975-4994-827f-954042adb480 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:01.221776 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-fb313a10-f13c-4887-a1e0-1cb8c2283ab0 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b167942c895345b186a3eda5c82175b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad2ab2705ca479ab4aaafe7c80de162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:59:01.230881 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-fb313a10-f13c-4887-a1e0-1cb8c2283ab0 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /compute/v2.1/servers/acc03344-b5df-4277-82e4-c9b3228969ca" status: 200 len: 1522 microversion: 2.1 time: 0.226369 May 26 14:59:01.231600 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 107/219] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:59:01 2021] GET /compute/v2.1/servers/acc03344-b5df-4277-82e4-c9b3228969ca => generated 1522 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:59:01.330383 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-7b2cb281-2975-4994-827f-954042adb480 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be4bd5c0f2a400da491bae101b48832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515325707f64d58a28f26451b2c74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:59:01.340275 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-7b2cb281-2975-4994-827f-954042adb480 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /compute/v2.1/servers/396d0570-c547-4549-8fe6-dd156ef64c4b" status: 200 len: 1317 microversion: 2.1 time: 0.247207 May 26 14:59:01.341244 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 113/220] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:59:01 2021] GET /compute/v2.1/servers/396d0570-c547-4549-8fe6-dd156ef64c4b => generated 1317 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 14:59:01.892532 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-df876091-ebe4-4aab-a4e3-0e82f983c826 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:59:01.893462 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-df876091-ebe4-4aab-a4e3-0e82f983c826 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 598b0e3f-8cf1-451a-80a8-ed7e5dd36984] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:01.903804 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-df876091-ebe4-4aab-a4e3-0e82f983c826 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:01.904276 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-df876091-ebe4-4aab-a4e3-0e82f983c826 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:01.905083 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-df876091-ebe4-4aab-a4e3-0e82f983c826 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:01.905521 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-df876091-ebe4-4aab-a4e3-0e82f983c826 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:01.910081 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-600e3dcb-bf07-4e0d-a189-c4d3abae4689 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:59:01.921077 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-600e3dcb-bf07-4e0d-a189-c4d3abae4689 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: a9d8f9a6-bd66-4caa-8662-4bb94655ae59] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:01.921077 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-600e3dcb-bf07-4e0d-a189-c4d3abae4689 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:01.921077 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-600e3dcb-bf07-4e0d-a189-c4d3abae4689 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:01.921077 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-600e3dcb-bf07-4e0d-a189-c4d3abae4689 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:01.921419 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-600e3dcb-bf07-4e0d-a189-c4d3abae4689 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:02.019296 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-df876091-ebe4-4aab-a4e3-0e82f983c826 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "POST /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984/action" status: 200 len: 28204 microversion: 2.20 time: 0.130315 May 26 14:59:02.024475 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 108/221] 10.222.0.81 () {62 vars in 1319 bytes} [Wed May 26 14:59:01 2021] POST /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984/action => generated 28204 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 26 14:59:02.039200 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-600e3dcb-bf07-4e0d-a189-c4d3abae4689 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "POST /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59/action" status: 200 len: 28636 microversion: 2.1 time: 0.133499 May 26 14:59:02.040211 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 114/222] 10.222.0.81 () {60 vars in 1278 bytes} [Wed May 26 14:59:01 2021] POST /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59/action => generated 28636 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 14:59:02.248800 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-28a72ea9-91b7-461d-9b88-7559ad7fdfef tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:59:02.249509 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-28a72ea9-91b7-461d-9b88-7559ad7fdfef tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] [instance: acc03344-b5df-4277-82e4-c9b3228969ca] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:02.257689 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-28a72ea9-91b7-461d-9b88-7559ad7fdfef tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:02.258152 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-28a72ea9-91b7-461d-9b88-7559ad7fdfef tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:02.259030 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-28a72ea9-91b7-461d-9b88-7559ad7fdfef tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:02.259472 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-28a72ea9-91b7-461d-9b88-7559ad7fdfef tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:02.361507 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-581f8d9c-0bdf-40e5-bdb6-abffea22e80d tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:59:02.362825 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-581f8d9c-0bdf-40e5-bdb6-abffea22e80d tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] [instance: 396d0570-c547-4549-8fe6-dd156ef64c4b] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:02.375140 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-581f8d9c-0bdf-40e5-bdb6-abffea22e80d tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:02.375605 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-581f8d9c-0bdf-40e5-bdb6-abffea22e80d tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:02.376458 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-581f8d9c-0bdf-40e5-bdb6-abffea22e80d tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:02.376908 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-581f8d9c-0bdf-40e5-bdb6-abffea22e80d tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:02.498921 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-28a72ea9-91b7-461d-9b88-7559ad7fdfef tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b167942c895345b186a3eda5c82175b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad2ab2705ca479ab4aaafe7c80de162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:59:02.522040 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-28a72ea9-91b7-461d-9b88-7559ad7fdfef tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /compute/v2.1/servers/acc03344-b5df-4277-82e4-c9b3228969ca" status: 200 len: 1502 microversion: 2.1 time: 0.274140 May 26 14:59:02.522686 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 109/223] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:59:02 2021] GET /compute/v2.1/servers/acc03344-b5df-4277-82e4-c9b3228969ca => generated 1502 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:59:02.543137 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-b58d362e-785d-4161-9f85-bdc081e4bfa0 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:59:02.545729 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-b58d362e-785d-4161-9f85-bdc081e4bfa0 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] [instance: aa145a33-41b1-4e39-9642-132aca11fcfe] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:02.556108 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-b58d362e-785d-4161-9f85-bdc081e4bfa0 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:02.556783 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-b58d362e-785d-4161-9f85-bdc081e4bfa0 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:02.557829 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-b58d362e-785d-4161-9f85-bdc081e4bfa0 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:02.558522 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-b58d362e-785d-4161-9f85-bdc081e4bfa0 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:02.705087 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-581f8d9c-0bdf-40e5-bdb6-abffea22e80d tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be4bd5c0f2a400da491bae101b48832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515325707f64d58a28f26451b2c74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:59:02.721346 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-581f8d9c-0bdf-40e5-bdb6-abffea22e80d tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /compute/v2.1/servers/396d0570-c547-4549-8fe6-dd156ef64c4b" status: 200 len: 1317 microversion: 2.1 time: 0.366426 May 26 14:59:02.731517 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 115/224] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:59:02 2021] GET /compute/v2.1/servers/396d0570-c547-4549-8fe6-dd156ef64c4b => generated 1317 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 14:59:02.737329 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [req-992fb728-1d44-401e-8f43-c1643277d237 req-cd6dee66-6b3b-413d-83b5-21bb59bd79b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "396d0570-c547-4549-8fe6-dd156ef64c4b", "name": "network-vif-plugged", "status": "completed", "tag": "5969b659-5456-4b6d-84cd-6a9fdbac70df"}]} {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:59:02.739034 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 14:59:02.739034 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: warnings.warn(msg) May 26 14:59:02.748216 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [req-992fb728-1d44-401e-8f43-c1643277d237 req-cd6dee66-6b3b-413d-83b5-21bb59bd79b6 service nova] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:02.749743 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [req-992fb728-1d44-401e-8f43-c1643277d237 req-cd6dee66-6b3b-413d-83b5-21bb59bd79b6 service nova] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:02.767869 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.compute.server_external_events [req-992fb728-1d44-401e-8f43-c1643277d237 req-cd6dee66-6b3b-413d-83b5-21bb59bd79b6 service nova] Creating event network-vif-plugged:5969b659-5456-4b6d-84cd-6a9fdbac70df for instance 396d0570-c547-4549-8fe6-dd156ef64c4b on hv-cinder-78414 May 26 14:59:02.775232 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [req-992fb728-1d44-401e-8f43-c1643277d237 req-cd6dee66-6b3b-413d-83b5-21bb59bd79b6 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042395 May 26 14:59:02.775830 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 116/225] 10.222.0.81 () {64 vars in 1318 bytes} [Wed May 26 14:59:02 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:59:02.830287 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-b58d362e-785d-4161-9f85-bdc081e4bfa0 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b167942c895345b186a3eda5c82175b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad2ab2705ca479ab4aaafe7c80de162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:59:02.841992 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-b58d362e-785d-4161-9f85-bdc081e4bfa0 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /compute/v2.1/servers/aa145a33-41b1-4e39-9642-132aca11fcfe" status: 200 len: 1515 microversion: 2.1 time: 0.302705 May 26 14:59:02.852808 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 110/226] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:59:02 2021] GET /compute/v2.1/servers/aa145a33-41b1-4e39-9642-132aca11fcfe => generated 1515 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 14:59:03.031391 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-e8899e63-286c-4bec-8e5c-bec6f43b9384 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:59:03.033007 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-e8899e63-286c-4bec-8e5c-bec6f43b9384 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 598b0e3f-8cf1-451a-80a8-ed7e5dd36984] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:03.040594 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-e8899e63-286c-4bec-8e5c-bec6f43b9384 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:03.041057 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-e8899e63-286c-4bec-8e5c-bec6f43b9384 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:03.041878 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-e8899e63-286c-4bec-8e5c-bec6f43b9384 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:03.042347 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-e8899e63-286c-4bec-8e5c-bec6f43b9384 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:03.057785 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-4d97e225-2870-45ae-b679-b7013a4e799a tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:59:03.058727 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-4d97e225-2870-45ae-b679-b7013a4e799a tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: a9d8f9a6-bd66-4caa-8662-4bb94655ae59] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:03.066243 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-4d97e225-2870-45ae-b679-b7013a4e799a tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:03.066693 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-4d97e225-2870-45ae-b679-b7013a4e799a tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:03.067464 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-4d97e225-2870-45ae-b679-b7013a4e799a tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:03.067901 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-4d97e225-2870-45ae-b679-b7013a4e799a tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:03.164528 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-e8899e63-286c-4bec-8e5c-bec6f43b9384 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "POST /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984/action" status: 200 len: 28204 microversion: 2.20 time: 0.137344 May 26 14:59:03.170512 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 117/227] 10.222.0.81 () {62 vars in 1319 bytes} [Wed May 26 14:59:03 2021] POST /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984/action => generated 28204 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 26 14:59:03.182844 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-4d97e225-2870-45ae-b679-b7013a4e799a tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "POST /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59/action" status: 200 len: 28636 microversion: 2.1 time: 0.127908 May 26 14:59:03.185107 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 111/228] 10.222.0.81 () {60 vars in 1278 bytes} [Wed May 26 14:59:03 2021] POST /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59/action => generated 28636 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 26 14:59:03.740107 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-e36b443c-af94-4726-aa5e-3e4debe6e316 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:59:03.745664 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-e36b443c-af94-4726-aa5e-3e4debe6e316 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] [instance: 396d0570-c547-4549-8fe6-dd156ef64c4b] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:03.759106 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-e36b443c-af94-4726-aa5e-3e4debe6e316 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:03.759570 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-e36b443c-af94-4726-aa5e-3e4debe6e316 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:03.760370 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-e36b443c-af94-4726-aa5e-3e4debe6e316 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:03.760815 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-e36b443c-af94-4726-aa5e-3e4debe6e316 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:04.058591 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-e36b443c-af94-4726-aa5e-3e4debe6e316 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be4bd5c0f2a400da491bae101b48832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515325707f64d58a28f26451b2c74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:59:04.068565 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-e36b443c-af94-4726-aa5e-3e4debe6e316 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /compute/v2.1/servers/396d0570-c547-4549-8fe6-dd156ef64c4b" status: 200 len: 1317 microversion: 2.1 time: 0.334368 May 26 14:59:04.069159 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 118/229] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:59:03 2021] GET /compute/v2.1/servers/396d0570-c547-4549-8fe6-dd156ef64c4b => generated 1317 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:59:04.182832 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-0cc0a981-b229-4e00-b477-b25932102cba tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:59:04.184786 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-0cc0a981-b229-4e00-b477-b25932102cba tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 598b0e3f-8cf1-451a-80a8-ed7e5dd36984] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:04.198742 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-0cc0a981-b229-4e00-b477-b25932102cba tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:04.198742 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-0cc0a981-b229-4e00-b477-b25932102cba tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:04.198742 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-0cc0a981-b229-4e00-b477-b25932102cba tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:04.198742 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-0cc0a981-b229-4e00-b477-b25932102cba tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:04.199447 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-b7917475-f589-411d-a37d-197dc8026e39 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:59:04.200540 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-b7917475-f589-411d-a37d-197dc8026e39 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: a9d8f9a6-bd66-4caa-8662-4bb94655ae59] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:04.209761 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-b7917475-f589-411d-a37d-197dc8026e39 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:04.210464 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-b7917475-f589-411d-a37d-197dc8026e39 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:04.211820 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-b7917475-f589-411d-a37d-197dc8026e39 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:04.212472 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-b7917475-f589-411d-a37d-197dc8026e39 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:04.301508 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-0cc0a981-b229-4e00-b477-b25932102cba tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "POST /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984/action" status: 200 len: 28495 microversion: 2.20 time: 0.123172 May 26 14:59:04.306453 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 112/230] 10.222.0.81 () {62 vars in 1319 bytes} [Wed May 26 14:59:04 2021] POST /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984/action => generated 28495 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 26 14:59:04.327590 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-b7917475-f589-411d-a37d-197dc8026e39 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "POST /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59/action" status: 200 len: 29581 microversion: 2.1 time: 0.132371 May 26 14:59:04.332384 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 119/231] 10.222.0.81 () {60 vars in 1278 bytes} [Wed May 26 14:59:04 2021] POST /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59/action => generated 29581 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 26 14:59:05.018064 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-8c24f080-190d-4303-8b5f-6b6358b6c98d tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:59:05.019104 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-8c24f080-190d-4303-8b5f-6b6358b6c98d tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] [instance: aa145a33-41b1-4e39-9642-132aca11fcfe] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:05.027191 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-8c24f080-190d-4303-8b5f-6b6358b6c98d tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:05.027648 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-8c24f080-190d-4303-8b5f-6b6358b6c98d tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:05.028485 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-8c24f080-190d-4303-8b5f-6b6358b6c98d tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:05.028913 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-8c24f080-190d-4303-8b5f-6b6358b6c98d tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:05.087791 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-e2c16373-6f32-41c8-a1ff-43127fc8a0ae tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:59:05.089114 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-e2c16373-6f32-41c8-a1ff-43127fc8a0ae tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] [instance: 396d0570-c547-4549-8fe6-dd156ef64c4b] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:05.098551 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-e2c16373-6f32-41c8-a1ff-43127fc8a0ae tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:05.099328 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-e2c16373-6f32-41c8-a1ff-43127fc8a0ae tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:05.100338 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-e2c16373-6f32-41c8-a1ff-43127fc8a0ae tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:05.101050 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-e2c16373-6f32-41c8-a1ff-43127fc8a0ae tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:05.104220 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.objects.instance [None req-8c24f080-190d-4303-8b5f-6b6358b6c98d tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lazy-loading 'flavor' on Instance uuid aa145a33-41b1-4e39-9642-132aca11fcfe {{(pid=118514) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 26 14:59:05.325475 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-e2c16373-6f32-41c8-a1ff-43127fc8a0ae tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be4bd5c0f2a400da491bae101b48832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515325707f64d58a28f26451b2c74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:59:05.338361 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-e2c16373-6f32-41c8-a1ff-43127fc8a0ae tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /compute/v2.1/servers/396d0570-c547-4549-8fe6-dd156ef64c4b" status: 200 len: 1507 microversion: 2.1 time: 0.255340 May 26 14:59:05.339186 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 120/232] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:59:05 2021] GET /compute/v2.1/servers/396d0570-c547-4549-8fe6-dd156ef64c4b => generated 1507 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:59:05.347382 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-a59ec456-470c-47be-8eb7-8518896b38cd tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:59:05.350562 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-a59ec456-470c-47be-8eb7-8518896b38cd tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 598b0e3f-8cf1-451a-80a8-ed7e5dd36984] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:05.363964 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-a59ec456-470c-47be-8eb7-8518896b38cd tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:05.364596 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-a59ec456-470c-47be-8eb7-8518896b38cd tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:05.365737 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-a59ec456-470c-47be-8eb7-8518896b38cd tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:05.366466 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-a59ec456-470c-47be-8eb7-8518896b38cd tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:05.497240 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-a59ec456-470c-47be-8eb7-8518896b38cd tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "POST /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984/action" status: 200 len: 28663 microversion: 2.20 time: 0.155858 May 26 14:59:05.498381 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 121/233] 10.222.0.81 () {62 vars in 1319 bytes} [Wed May 26 14:59:05 2021] POST /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984/action => generated 28663 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 26 14:59:05.510170 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-b81cbc7b-ebfd-42a1-94e9-35aafc05f140 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:59:05.511593 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-b81cbc7b-ebfd-42a1-94e9-35aafc05f140 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: a9d8f9a6-bd66-4caa-8662-4bb94655ae59] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:05.524170 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-b81cbc7b-ebfd-42a1-94e9-35aafc05f140 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:05.525732 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-b81cbc7b-ebfd-42a1-94e9-35aafc05f140 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:05.527723 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-b81cbc7b-ebfd-42a1-94e9-35aafc05f140 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:05.535829 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-b81cbc7b-ebfd-42a1-94e9-35aafc05f140 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:05.566092 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-8c24f080-190d-4303-8b5f-6b6358b6c98d tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "POST /compute/v2.1/servers/aa145a33-41b1-4e39-9642-132aca11fcfe/action" status: 200 len: 32 microversion: 2.1 time: 0.553370 May 26 14:59:05.573265 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 113/234] 10.222.0.81 () {60 vars in 1278 bytes} [Wed May 26 14:59:05 2021] POST /compute/v2.1/servers/aa145a33-41b1-4e39-9642-132aca11fcfe/action => generated 32 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 26 14:59:05.584190 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-a2b40bdc-d4f1-4131-a95f-5bf1d4c8372e tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:59:05.586297 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-a2b40bdc-d4f1-4131-a95f-5bf1d4c8372e tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] [instance: aa145a33-41b1-4e39-9642-132aca11fcfe] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:05.599236 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-a2b40bdc-d4f1-4131-a95f-5bf1d4c8372e tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:05.599691 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-a2b40bdc-d4f1-4131-a95f-5bf1d4c8372e tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:05.600528 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-a2b40bdc-d4f1-4131-a95f-5bf1d4c8372e tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:05.601346 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-a2b40bdc-d4f1-4131-a95f-5bf1d4c8372e tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:05.684765 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-b81cbc7b-ebfd-42a1-94e9-35aafc05f140 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "POST /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59/action" status: 200 len: 31783 microversion: 2.1 time: 0.184267 May 26 14:59:05.685730 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 122/235] 10.222.0.81 () {60 vars in 1278 bytes} [Wed May 26 14:59:05 2021] POST /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59/action => generated 31783 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 14:59:06.055784 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-a2b40bdc-d4f1-4131-a95f-5bf1d4c8372e tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b167942c895345b186a3eda5c82175b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad2ab2705ca479ab4aaafe7c80de162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:59:06.065315 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-a2b40bdc-d4f1-4131-a95f-5bf1d4c8372e tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /compute/v2.1/servers/aa145a33-41b1-4e39-9642-132aca11fcfe" status: 200 len: 1521 microversion: 2.1 time: 0.490424 May 26 14:59:06.066387 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 114/236] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:59:05 2021] GET /compute/v2.1/servers/aa145a33-41b1-4e39-9642-132aca11fcfe => generated 1521 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:59:06.517522 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-71248db8-771c-4365-a4e9-f526d0ea82a0 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:59:06.520084 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-71248db8-771c-4365-a4e9-f526d0ea82a0 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 598b0e3f-8cf1-451a-80a8-ed7e5dd36984] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:06.529811 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-71248db8-771c-4365-a4e9-f526d0ea82a0 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:06.530313 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-71248db8-771c-4365-a4e9-f526d0ea82a0 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:06.531715 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-71248db8-771c-4365-a4e9-f526d0ea82a0 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:06.533017 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-71248db8-771c-4365-a4e9-f526d0ea82a0 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:06.654047 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-71248db8-771c-4365-a4e9-f526d0ea82a0 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "POST /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984/action" status: 200 len: 28663 microversion: 2.20 time: 0.142005 May 26 14:59:06.656310 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 123/237] 10.222.0.81 () {62 vars in 1319 bytes} [Wed May 26 14:59:06 2021] POST /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984/action => generated 28663 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 26 14:59:06.697639 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-380ff954-e27d-4bec-b36c-f17416f9e22f tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:59:06.698571 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-380ff954-e27d-4bec-b36c-f17416f9e22f tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: a9d8f9a6-bd66-4caa-8662-4bb94655ae59] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:06.706931 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-380ff954-e27d-4bec-b36c-f17416f9e22f tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:06.707387 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-380ff954-e27d-4bec-b36c-f17416f9e22f tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:06.708431 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-380ff954-e27d-4bec-b36c-f17416f9e22f tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:06.709056 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-380ff954-e27d-4bec-b36c-f17416f9e22f tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:06.871629 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-380ff954-e27d-4bec-b36c-f17416f9e22f tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "POST /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59/action" status: 200 len: 33005 microversion: 2.1 time: 0.177382 May 26 14:59:06.877756 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 115/238] 10.222.0.81 () {60 vars in 1278 bytes} [Wed May 26 14:59:06 2021] POST /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59/action => generated 33005 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 14:59:07.083855 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-9b21bae7-d75e-4ef1-8642-7e583b6de518 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:59:07.085182 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-9b21bae7-d75e-4ef1-8642-7e583b6de518 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] [instance: aa145a33-41b1-4e39-9642-132aca11fcfe] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:07.093520 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-9b21bae7-d75e-4ef1-8642-7e583b6de518 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:07.094038 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-9b21bae7-d75e-4ef1-8642-7e583b6de518 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:07.094871 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-9b21bae7-d75e-4ef1-8642-7e583b6de518 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:07.095313 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-9b21bae7-d75e-4ef1-8642-7e583b6de518 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:07.298771 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-9b21bae7-d75e-4ef1-8642-7e583b6de518 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b167942c895345b186a3eda5c82175b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad2ab2705ca479ab4aaafe7c80de162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:59:07.311682 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-9b21bae7-d75e-4ef1-8642-7e583b6de518 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /compute/v2.1/servers/aa145a33-41b1-4e39-9642-132aca11fcfe" status: 200 len: 1521 microversion: 2.1 time: 0.227492 May 26 14:59:07.311682 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 124/239] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:59:07 2021] GET /compute/v2.1/servers/aa145a33-41b1-4e39-9642-132aca11fcfe => generated 1521 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:59:07.602980 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-cd561280-7af6-46b9-bd09-9e89757a58cb tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5977b52d-1937-437c-bdb0-2973e0fec095"}} {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:59:07.604135 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-cd561280-7af6-46b9-bd09-9e89757a58cb tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] [instance: 396d0570-c547-4549-8fe6-dd156ef64c4b] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:07.617056 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-cd561280-7af6-46b9-bd09-9e89757a58cb tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:07.617056 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-cd561280-7af6-46b9-bd09-9e89757a58cb tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:07.619412 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-cd561280-7af6-46b9-bd09-9e89757a58cb tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:07.619756 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-cd561280-7af6-46b9-bd09-9e89757a58cb tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:07.666661 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-fe463132-5c08-43a7-9fff-e042d3081e3a tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:59:07.668271 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-fe463132-5c08-43a7-9fff-e042d3081e3a tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 598b0e3f-8cf1-451a-80a8-ed7e5dd36984] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:07.681170 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-fe463132-5c08-43a7-9fff-e042d3081e3a tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:07.684260 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-fe463132-5c08-43a7-9fff-e042d3081e3a tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:07.685323 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-fe463132-5c08-43a7-9fff-e042d3081e3a tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:07.686071 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-fe463132-5c08-43a7-9fff-e042d3081e3a tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:07.807464 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-fe463132-5c08-43a7-9fff-e042d3081e3a tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "POST /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984/action" status: 200 len: 28663 microversion: 2.20 time: 0.144421 May 26 14:59:07.808111 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 125/240] 10.222.0.81 () {62 vars in 1319 bytes} [Wed May 26 14:59:07 2021] POST /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984/action => generated 28663 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 26 14:59:07.885329 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-182a9571-ff18-4ebe-af75-aeb95f5dc523 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:59:07.886374 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-182a9571-ff18-4ebe-af75-aeb95f5dc523 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: a9d8f9a6-bd66-4caa-8662-4bb94655ae59] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:07.896226 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-182a9571-ff18-4ebe-af75-aeb95f5dc523 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:07.896681 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-182a9571-ff18-4ebe-af75-aeb95f5dc523 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:07.897692 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-182a9571-ff18-4ebe-af75-aeb95f5dc523 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:07.898249 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-182a9571-ff18-4ebe-af75-aeb95f5dc523 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:08.005232 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-182a9571-ff18-4ebe-af75-aeb95f5dc523 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "POST /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59/action" status: 200 len: 33649 microversion: 2.1 time: 0.123842 May 26 14:59:08.013422 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 126/241] 10.222.0.81 () {60 vars in 1278 bytes} [Wed May 26 14:59:07 2021] POST /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59/action => generated 33649 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 14:59:08.332325 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-d3deff40-6589-4730-88e3-7df1d7f044e3 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:59:08.332871 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-d3deff40-6589-4730-88e3-7df1d7f044e3 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] [instance: aa145a33-41b1-4e39-9642-132aca11fcfe] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:08.351066 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-d3deff40-6589-4730-88e3-7df1d7f044e3 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:08.351066 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-d3deff40-6589-4730-88e3-7df1d7f044e3 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:08.351066 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-d3deff40-6589-4730-88e3-7df1d7f044e3 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:08.351066 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-d3deff40-6589-4730-88e3-7df1d7f044e3 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:08.607129 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-d3deff40-6589-4730-88e3-7df1d7f044e3 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b167942c895345b186a3eda5c82175b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad2ab2705ca479ab4aaafe7c80de162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:59:08.615805 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-d3deff40-6589-4730-88e3-7df1d7f044e3 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /compute/v2.1/servers/aa145a33-41b1-4e39-9642-132aca11fcfe" status: 200 len: 1521 microversion: 2.1 time: 0.289432 May 26 14:59:08.616383 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 127/242] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:59:08 2021] GET /compute/v2.1/servers/aa145a33-41b1-4e39-9642-132aca11fcfe => generated 1521 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:59:08.819651 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-cd561280-7af6-46b9-bd09-9e89757a58cb tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "POST /compute/v2.1/servers/396d0570-c547-4549-8fe6-dd156ef64c4b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.214092 May 26 14:59:08.820118 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-84a3ea3c-264f-4d2a-9287-8b4a74faddea tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:59:08.820549 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-84a3ea3c-264f-4d2a-9287-8b4a74faddea tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 598b0e3f-8cf1-451a-80a8-ed7e5dd36984] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:08.825008 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 116/243] 10.222.0.81 () {60 vars in 1323 bytes} [Wed May 26 14:59:07 2021] POST /compute/v2.1/servers/396d0570-c547-4549-8fe6-dd156ef64c4b/os-volume_attachments => generated 194 bytes in 1227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:59:08.827948 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-84a3ea3c-264f-4d2a-9287-8b4a74faddea tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:08.828590 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-84a3ea3c-264f-4d2a-9287-8b4a74faddea tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:08.829532 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-84a3ea3c-264f-4d2a-9287-8b4a74faddea tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:08.830005 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-84a3ea3c-264f-4d2a-9287-8b4a74faddea tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:08.930321 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-84a3ea3c-264f-4d2a-9287-8b4a74faddea tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "POST /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984/action" status: 200 len: 28663 microversion: 2.20 time: 0.114379 May 26 14:59:08.930900 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 128/244] 10.222.0.81 () {62 vars in 1319 bytes} [Wed May 26 14:59:08 2021] POST /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984/action => generated 28663 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 26 14:59:09.018042 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-461b2ec7-1857-450d-a389-29e4f1ff63c4 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:59:09.019194 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-461b2ec7-1857-450d-a389-29e4f1ff63c4 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: a9d8f9a6-bd66-4caa-8662-4bb94655ae59] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:09.028764 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-1e1deb19-0520-4518-a40b-b18d2182a8a2 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1978242144", "imageRef": "dcacad62-e278-4869-aa20-e5df07dd03db", "flavorRef": "452"}} {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:59:09.038014 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-461b2ec7-1857-450d-a389-29e4f1ff63c4 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:09.038476 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-461b2ec7-1857-450d-a389-29e4f1ff63c4 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:09.039268 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-461b2ec7-1857-450d-a389-29e4f1ff63c4 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:09.039714 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-461b2ec7-1857-450d-a389-29e4f1ff63c4 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:09.104887 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.network.neutron [None req-1e1deb19-0520-4518-a40b-b18d2182a8a2 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] validate_networks() for None {{(pid=118513) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} May 26 14:59:09.169017 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-461b2ec7-1857-450d-a389-29e4f1ff63c4 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "POST /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59/action" status: 200 len: 34584 microversion: 2.1 time: 0.156075 May 26 14:59:09.170322 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 117/245] 10.222.0.81 () {60 vars in 1278 bytes} [Wed May 26 14:59:09 2021] POST /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59/action => generated 34584 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 26 14:59:09.397903 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.virt.hardware [None req-1e1deb19-0520-4518-a40b-b18d2182a8a2 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Flavor limits 0:0:0 {{(pid=118513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} May 26 14:59:09.398572 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.virt.hardware [None req-1e1deb19-0520-4518-a40b-b18d2182a8a2 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Image limits 0:0:0 {{(pid=118513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} May 26 14:59:09.399131 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.virt.hardware [None req-1e1deb19-0520-4518-a40b-b18d2182a8a2 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Flavor pref 0:0:0 {{(pid=118513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} May 26 14:59:09.399750 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.virt.hardware [None req-1e1deb19-0520-4518-a40b-b18d2182a8a2 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Image pref 0:0:0 {{(pid=118513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} May 26 14:59:09.400396 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.virt.hardware [None req-1e1deb19-0520-4518-a40b-b18d2182a8a2 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} May 26 14:59:09.423756 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-1e1deb19-0520-4518-a40b-b18d2182a8a2 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:09.423756 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-1e1deb19-0520-4518-a40b-b18d2182a8a2 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:09.423756 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-1e1deb19-0520-4518-a40b-b18d2182a8a2 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:09.423756 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-1e1deb19-0520-4518-a40b-b18d2182a8a2 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:09.436645 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.quota [None req-1e1deb19-0520-4518-a40b-b18d2182a8a2 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Getting quotas for project 5a4d985046c34c1eb9e28915d7ebb5b5. Resources: {'instances', 'ram', 'cores'} {{(pid=118513) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 26 14:59:09.444257 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.quota [None req-1e1deb19-0520-4518-a40b-b18d2182a8a2 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Getting quotas for user be9e511074f445b09a3691e3328bee34 and project 5a4d985046c34c1eb9e28915d7ebb5b5. Resources: {'instances', 'ram', 'cores'} {{(pid=118513) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 26 14:59:09.464441 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-1e1deb19-0520-4518-a40b-b18d2182a8a2 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Going to run 1 instances... {{(pid=118513) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 26 14:59:09.467375 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-1e1deb19-0520-4518-a40b-b18d2182a8a2 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] [instance: 9357694b-0ef8-4988-9fd0-f795855f9a99] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dcacad62-e278-4869-aa20-e5df07dd03db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118513) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} May 26 14:59:09.634521 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-2d150012-7c3d-4909-bd6b-9088038982ea tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:59:09.635268 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-2d150012-7c3d-4909-bd6b-9088038982ea tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] [instance: aa145a33-41b1-4e39-9642-132aca11fcfe] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:09.644064 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-2d150012-7c3d-4909-bd6b-9088038982ea tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:09.644522 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-2d150012-7c3d-4909-bd6b-9088038982ea tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:09.645308 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-2d150012-7c3d-4909-bd6b-9088038982ea tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:09.645780 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-2d150012-7c3d-4909-bd6b-9088038982ea tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:09.677306 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-1e1deb19-0520-4518-a40b-b18d2182a8a2 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.653067 May 26 14:59:09.683788 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 129/246] 10.222.0.81 () {60 vars in 1147 bytes} [Wed May 26 14:59:09 2021] POST /compute/v2.1/servers => generated 380 bytes in 661 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 14:59:09.697283 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-2369035b-6d78-42f5-adcb-46209d3adc7c tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:59:09.697283 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-2369035b-6d78-42f5-adcb-46209d3adc7c tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] [instance: 9357694b-0ef8-4988-9fd0-f795855f9a99] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:09.792650 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-2369035b-6d78-42f5-adcb-46209d3adc7c tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9e511074f445b09a3691e3328bee34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4d985046c34c1eb9e28915d7ebb5b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:59:09.802691 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-2369035b-6d78-42f5-adcb-46209d3adc7c tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] 10.222.0.81 "GET /compute/v2.1/servers/9357694b-0ef8-4988-9fd0-f795855f9a99" status: 200 len: 1215 microversion: 2.1 time: 0.111732 May 26 14:59:09.803287 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 130/247] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:59:09 2021] GET /compute/v2.1/servers/9357694b-0ef8-4988-9fd0-f795855f9a99 => generated 1215 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:59:09.914385 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-2d150012-7c3d-4909-bd6b-9088038982ea tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b167942c895345b186a3eda5c82175b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad2ab2705ca479ab4aaafe7c80de162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:59:09.923811 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-2d150012-7c3d-4909-bd6b-9088038982ea tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /compute/v2.1/servers/aa145a33-41b1-4e39-9642-132aca11fcfe" status: 200 len: 1521 microversion: 2.1 time: 0.293092 May 26 14:59:09.924426 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 118/248] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:59:09 2021] GET /compute/v2.1/servers/aa145a33-41b1-4e39-9642-132aca11fcfe => generated 1521 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 14:59:09.944138 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-c1b3c3e1-9669-4197-a3bc-13e87f014abc tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:59:09.945369 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-c1b3c3e1-9669-4197-a3bc-13e87f014abc tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 598b0e3f-8cf1-451a-80a8-ed7e5dd36984] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:09.953312 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-c1b3c3e1-9669-4197-a3bc-13e87f014abc tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:09.954990 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-c1b3c3e1-9669-4197-a3bc-13e87f014abc tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:09.956026 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-c1b3c3e1-9669-4197-a3bc-13e87f014abc tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:09.956594 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-c1b3c3e1-9669-4197-a3bc-13e87f014abc tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:10.075510 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-c1b3c3e1-9669-4197-a3bc-13e87f014abc tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "POST /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984/action" status: 200 len: 28663 microversion: 2.20 time: 0.136056 May 26 14:59:10.079548 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 131/249] 10.222.0.81 () {62 vars in 1319 bytes} [Wed May 26 14:59:09 2021] POST /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984/action => generated 28663 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 26 14:59:10.180773 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-9f77f9ea-74c8-4a75-9e29-98ba6ef1b9d2 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:59:10.181738 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-9f77f9ea-74c8-4a75-9e29-98ba6ef1b9d2 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: a9d8f9a6-bd66-4caa-8662-4bb94655ae59] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:10.189705 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-9f77f9ea-74c8-4a75-9e29-98ba6ef1b9d2 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:10.190170 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-9f77f9ea-74c8-4a75-9e29-98ba6ef1b9d2 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:10.190964 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-9f77f9ea-74c8-4a75-9e29-98ba6ef1b9d2 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:10.191415 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-9f77f9ea-74c8-4a75-9e29-98ba6ef1b9d2 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:10.302203 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-9f77f9ea-74c8-4a75-9e29-98ba6ef1b9d2 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "POST /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59/action" status: 200 len: 35598 microversion: 2.1 time: 0.124914 May 26 14:59:10.303092 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 119/250] 10.222.0.81 () {60 vars in 1278 bytes} [Wed May 26 14:59:10 2021] POST /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59/action => generated 35598 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 14:59:10.681924 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-2e3ffd02-0eff-4d6e-8897-75752a308efb tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1847905700", "imageRef": "dcacad62-e278-4869-aa20-e5df07dd03db", "flavorRef": "452", "networks": [{"uuid": "9f5bc9eb-1964-454a-a177-4bdcfc4e0298"}]}} {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:59:10.752954 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.network.neutron [None req-2e3ffd02-0eff-4d6e-8897-75752a308efb tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] validate_networks() for [('9f5bc9eb-1964-454a-a177-4bdcfc4e0298', None, None, None)] {{(pid=118513) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} May 26 14:59:10.819791 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-1663fce1-e6c7-41c2-811a-a089548b9db3 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:59:10.820493 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-1663fce1-e6c7-41c2-811a-a089548b9db3 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] [instance: 9357694b-0ef8-4988-9fd0-f795855f9a99] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:10.905498 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-1663fce1-e6c7-41c2-811a-a089548b9db3 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9e511074f445b09a3691e3328bee34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4d985046c34c1eb9e28915d7ebb5b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:59:10.911030 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-1663fce1-e6c7-41c2-811a-a089548b9db3 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] 10.222.0.81 "GET /compute/v2.1/servers/9357694b-0ef8-4988-9fd0-f795855f9a99" status: 200 len: 1215 microversion: 2.1 time: 0.095325 May 26 14:59:10.911808 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 120/251] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:59:10 2021] GET /compute/v2.1/servers/9357694b-0ef8-4988-9fd0-f795855f9a99 => generated 1215 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 14:59:10.941072 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-66b126d4-dcbd-48f5-b29d-8b1dfe83c516 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:59:10.941716 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-66b126d4-dcbd-48f5-b29d-8b1dfe83c516 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] [instance: aa145a33-41b1-4e39-9642-132aca11fcfe] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:10.949969 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-66b126d4-dcbd-48f5-b29d-8b1dfe83c516 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:10.950422 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-66b126d4-dcbd-48f5-b29d-8b1dfe83c516 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:10.951220 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-66b126d4-dcbd-48f5-b29d-8b1dfe83c516 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:10.951654 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-66b126d4-dcbd-48f5-b29d-8b1dfe83c516 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:11.174223 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-66b126d4-dcbd-48f5-b29d-8b1dfe83c516 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b167942c895345b186a3eda5c82175b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad2ab2705ca479ab4aaafe7c80de162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:59:11.183572 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-66b126d4-dcbd-48f5-b29d-8b1dfe83c516 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /compute/v2.1/servers/aa145a33-41b1-4e39-9642-132aca11fcfe" status: 200 len: 1521 microversion: 2.1 time: 0.246898 May 26 14:59:11.194371 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 121/252] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:59:10 2021] GET /compute/v2.1/servers/aa145a33-41b1-4e39-9642-132aca11fcfe => generated 1521 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:59:11.194371 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-c462eea6-074c-408d-81d2-f2d9719001e0 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:59:11.194371 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-c462eea6-074c-408d-81d2-f2d9719001e0 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 598b0e3f-8cf1-451a-80a8-ed7e5dd36984] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:11.198487 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-c462eea6-074c-408d-81d2-f2d9719001e0 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:11.207491 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-c462eea6-074c-408d-81d2-f2d9719001e0 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:11.207491 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-c462eea6-074c-408d-81d2-f2d9719001e0 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:11.207491 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-c462eea6-074c-408d-81d2-f2d9719001e0 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:11.309779 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.virt.hardware [None req-2e3ffd02-0eff-4d6e-8897-75752a308efb tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Flavor limits 0:0:0 {{(pid=118513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} May 26 14:59:11.310252 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.virt.hardware [None req-2e3ffd02-0eff-4d6e-8897-75752a308efb tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Image limits 0:0:0 {{(pid=118513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} May 26 14:59:11.311263 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.virt.hardware [None req-2e3ffd02-0eff-4d6e-8897-75752a308efb tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Flavor pref 0:0:0 {{(pid=118513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} May 26 14:59:11.311701 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.virt.hardware [None req-2e3ffd02-0eff-4d6e-8897-75752a308efb tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Image pref 0:0:0 {{(pid=118513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} May 26 14:59:11.312125 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.virt.hardware [None req-2e3ffd02-0eff-4d6e-8897-75752a308efb tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} May 26 14:59:11.323800 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-c462eea6-074c-408d-81d2-f2d9719001e0 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "POST /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984/action" status: 200 len: 30378 microversion: 2.20 time: 0.137957 May 26 14:59:11.324276 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-2e3ffd02-0eff-4d6e-8897-75752a308efb tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:11.325255 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 122/253] 10.222.0.81 () {62 vars in 1319 bytes} [Wed May 26 14:59:11 2021] POST /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984/action => generated 30378 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 26 14:59:11.325370 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-2e3ffd02-0eff-4d6e-8897-75752a308efb tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:11.328726 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-2e3ffd02-0eff-4d6e-8897-75752a308efb tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:11.328726 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-2e3ffd02-0eff-4d6e-8897-75752a308efb tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:11.333291 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-9cedd848-33af-48a1-838e-827a0d7996cc tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:59:11.334326 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-9cedd848-33af-48a1-838e-827a0d7996cc tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: a9d8f9a6-bd66-4caa-8662-4bb94655ae59] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:11.343748 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-9cedd848-33af-48a1-838e-827a0d7996cc tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:11.343748 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-9cedd848-33af-48a1-838e-827a0d7996cc tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:11.343748 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-9cedd848-33af-48a1-838e-827a0d7996cc tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:11.344249 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-9cedd848-33af-48a1-838e-827a0d7996cc tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:11.347183 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.quota [None req-2e3ffd02-0eff-4d6e-8897-75752a308efb tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Getting quotas for project 5b729993a1944061bb0a708877c95a5c. Resources: {'instances', 'ram', 'cores'} {{(pid=118513) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 26 14:59:11.351364 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.quota [None req-2e3ffd02-0eff-4d6e-8897-75752a308efb tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Getting quotas for user 0b8604f942d44fec96828cc0b1ae5960 and project 5b729993a1944061bb0a708877c95a5c. Resources: {'instances', 'ram', 'cores'} {{(pid=118513) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 26 14:59:11.363245 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-2e3ffd02-0eff-4d6e-8897-75752a308efb tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Going to run 1 instances... {{(pid=118513) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 26 14:59:11.365780 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-2e3ffd02-0eff-4d6e-8897-75752a308efb tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] [instance: 990431e1-82cb-42b0-a288-949d79e21762] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dcacad62-e278-4869-aa20-e5df07dd03db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118513) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} May 26 14:59:11.458850 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-9cedd848-33af-48a1-838e-827a0d7996cc tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "POST /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59/action" status: 200 len: 36852 microversion: 2.1 time: 0.132452 May 26 14:59:11.461517 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 123/254] 10.222.0.81 () {60 vars in 1278 bytes} [Wed May 26 14:59:11 2021] POST /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59/action => generated 36852 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 14:59:11.486733 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-2e3ffd02-0eff-4d6e-8897-75752a308efb tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.810009 May 26 14:59:11.487385 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 132/255] 10.222.0.81 () {60 vars in 1147 bytes} [Wed May 26 14:59:10 2021] POST /compute/v2.1/servers => generated 380 bytes in 812 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 14:59:11.498263 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-026b4e02-66dc-49d3-a15b-4d9decd9866b tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:59:11.499127 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-026b4e02-66dc-49d3-a15b-4d9decd9866b tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] [instance: 990431e1-82cb-42b0-a288-949d79e21762] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:11.589711 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-026b4e02-66dc-49d3-a15b-4d9decd9866b tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8604f942d44fec96828cc0b1ae5960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b729993a1944061bb0a708877c95a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:59:11.599415 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-026b4e02-66dc-49d3-a15b-4d9decd9866b tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] 10.222.0.81 "GET /compute/v2.1/servers/990431e1-82cb-42b0-a288-949d79e21762" status: 200 len: 1219 microversion: 2.1 time: 0.105684 May 26 14:59:11.600006 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 124/256] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:59:11 2021] GET /compute/v2.1/servers/990431e1-82cb-42b0-a288-949d79e21762 => generated 1219 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:59:11.927914 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-93bd2a72-4839-4e6d-abb1-39fe97c0a390 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:59:11.928531 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-93bd2a72-4839-4e6d-abb1-39fe97c0a390 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] [instance: 9357694b-0ef8-4988-9fd0-f795855f9a99] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:11.936565 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-93bd2a72-4839-4e6d-abb1-39fe97c0a390 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:11.937028 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-93bd2a72-4839-4e6d-abb1-39fe97c0a390 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:11.937835 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-93bd2a72-4839-4e6d-abb1-39fe97c0a390 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:11.938415 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-93bd2a72-4839-4e6d-abb1-39fe97c0a390 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:12.061412 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-93bd2a72-4839-4e6d-abb1-39fe97c0a390 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9e511074f445b09a3691e3328bee34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4d985046c34c1eb9e28915d7ebb5b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:59:12.069897 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-93bd2a72-4839-4e6d-abb1-39fe97c0a390 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] 10.222.0.81 "GET /compute/v2.1/servers/9357694b-0ef8-4988-9fd0-f795855f9a99" status: 200 len: 1267 microversion: 2.1 time: 0.146023 May 26 14:59:12.070464 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 133/257] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:59:11 2021] GET /compute/v2.1/servers/9357694b-0ef8-4988-9fd0-f795855f9a99 => generated 1267 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:59:12.201088 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-e8dfd318-bed6-4625-9b58-d8a80e913f70 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:59:12.201088 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-e8dfd318-bed6-4625-9b58-d8a80e913f70 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] [instance: aa145a33-41b1-4e39-9642-132aca11fcfe] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:12.209665 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-e8dfd318-bed6-4625-9b58-d8a80e913f70 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:12.210124 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-e8dfd318-bed6-4625-9b58-d8a80e913f70 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:12.211927 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-e8dfd318-bed6-4625-9b58-d8a80e913f70 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:12.211927 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-e8dfd318-bed6-4625-9b58-d8a80e913f70 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:12.339546 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-d7356f4c-10d4-491d-a872-298793ad56d3 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:59:12.342527 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-d7356f4c-10d4-491d-a872-298793ad56d3 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 598b0e3f-8cf1-451a-80a8-ed7e5dd36984] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:12.357963 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-d7356f4c-10d4-491d-a872-298793ad56d3 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:12.357963 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-d7356f4c-10d4-491d-a872-298793ad56d3 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:12.357963 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-d7356f4c-10d4-491d-a872-298793ad56d3 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:12.357963 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-d7356f4c-10d4-491d-a872-298793ad56d3 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:12.463130 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-d7356f4c-10d4-491d-a872-298793ad56d3 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "POST /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984/action" status: 200 len: 32378 microversion: 2.20 time: 0.130023 May 26 14:59:12.464272 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 134/258] 10.222.0.81 () {62 vars in 1319 bytes} [Wed May 26 14:59:12 2021] POST /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984/action => generated 32378 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 26 14:59:12.473729 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-224ee07a-6182-4807-a968-abf1f4b6f5f1 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:59:12.481526 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-224ee07a-6182-4807-a968-abf1f4b6f5f1 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: a9d8f9a6-bd66-4caa-8662-4bb94655ae59] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:12.484442 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-224ee07a-6182-4807-a968-abf1f4b6f5f1 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:12.485300 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-224ee07a-6182-4807-a968-abf1f4b6f5f1 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:12.486312 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-224ee07a-6182-4807-a968-abf1f4b6f5f1 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:12.487279 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-224ee07a-6182-4807-a968-abf1f4b6f5f1 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:12.489913 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-e8dfd318-bed6-4625-9b58-d8a80e913f70 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b167942c895345b186a3eda5c82175b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad2ab2705ca479ab4aaafe7c80de162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:59:12.500137 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-e8dfd318-bed6-4625-9b58-d8a80e913f70 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /compute/v2.1/servers/aa145a33-41b1-4e39-9642-132aca11fcfe" status: 200 len: 1521 microversion: 2.1 time: 0.303545 May 26 14:59:12.511536 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 125/259] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:59:12 2021] GET /compute/v2.1/servers/aa145a33-41b1-4e39-9642-132aca11fcfe => generated 1521 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:59:12.597026 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-224ee07a-6182-4807-a968-abf1f4b6f5f1 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "POST /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59/action" status: 200 len: 38041 microversion: 2.1 time: 0.128177 May 26 14:59:12.601189 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 135/260] 10.222.0.81 () {60 vars in 1278 bytes} [Wed May 26 14:59:12 2021] POST /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59/action => generated 38041 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 14:59:12.616229 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-89001f39-4d58-4736-983e-fa410e009fa4 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:59:12.616855 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-89001f39-4d58-4736-983e-fa410e009fa4 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] [instance: 990431e1-82cb-42b0-a288-949d79e21762] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:12.625971 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-89001f39-4d58-4736-983e-fa410e009fa4 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:12.626423 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-89001f39-4d58-4736-983e-fa410e009fa4 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:12.627413 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-89001f39-4d58-4736-983e-fa410e009fa4 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:12.627851 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-89001f39-4d58-4736-983e-fa410e009fa4 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:12.762307 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-89001f39-4d58-4736-983e-fa410e009fa4 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8604f942d44fec96828cc0b1ae5960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b729993a1944061bb0a708877c95a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:59:12.772836 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-89001f39-4d58-4736-983e-fa410e009fa4 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] 10.222.0.81 "GET /compute/v2.1/servers/990431e1-82cb-42b0-a288-949d79e21762" status: 200 len: 1223 microversion: 2.1 time: 0.160425 May 26 14:59:12.773599 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 126/261] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:59:12 2021] GET /compute/v2.1/servers/990431e1-82cb-42b0-a288-949d79e21762 => generated 1223 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:59:13.092516 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-33f49f79-1b6e-4ce9-9f94-e72778255a82 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:59:13.093473 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-33f49f79-1b6e-4ce9-9f94-e72778255a82 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] [instance: 9357694b-0ef8-4988-9fd0-f795855f9a99] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:13.102937 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-33f49f79-1b6e-4ce9-9f94-e72778255a82 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:13.103426 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-33f49f79-1b6e-4ce9-9f94-e72778255a82 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:13.104264 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-33f49f79-1b6e-4ce9-9f94-e72778255a82 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:13.104700 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-33f49f79-1b6e-4ce9-9f94-e72778255a82 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:13.241259 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-33f49f79-1b6e-4ce9-9f94-e72778255a82 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9e511074f445b09a3691e3328bee34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4d985046c34c1eb9e28915d7ebb5b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:59:13.249857 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-33f49f79-1b6e-4ce9-9f94-e72778255a82 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] 10.222.0.81 "GET /compute/v2.1/servers/9357694b-0ef8-4988-9fd0-f795855f9a99" status: 200 len: 1273 microversion: 2.1 time: 0.165226 May 26 14:59:13.250960 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 136/262] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:59:13 2021] GET /compute/v2.1/servers/9357694b-0ef8-4988-9fd0-f795855f9a99 => generated 1273 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 14:59:13.477999 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-33fbc082-964c-4d2e-9171-a680bf0d7a64 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:59:13.480069 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-33fbc082-964c-4d2e-9171-a680bf0d7a64 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 598b0e3f-8cf1-451a-80a8-ed7e5dd36984] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:13.489154 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-33fbc082-964c-4d2e-9171-a680bf0d7a64 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:13.489978 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-33fbc082-964c-4d2e-9171-a680bf0d7a64 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:13.491211 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-33fbc082-964c-4d2e-9171-a680bf0d7a64 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:13.491768 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-33fbc082-964c-4d2e-9171-a680bf0d7a64 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:13.518220 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-a0083d27-5e66-482f-a8be-dc98284e83b1 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:59:13.518966 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-a0083d27-5e66-482f-a8be-dc98284e83b1 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] [instance: aa145a33-41b1-4e39-9642-132aca11fcfe] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:13.536829 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-a0083d27-5e66-482f-a8be-dc98284e83b1 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:13.537284 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-a0083d27-5e66-482f-a8be-dc98284e83b1 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:13.538183 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-a0083d27-5e66-482f-a8be-dc98284e83b1 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:13.538685 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-a0083d27-5e66-482f-a8be-dc98284e83b1 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:13.633519 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-33fbc082-964c-4d2e-9171-a680bf0d7a64 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "POST /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984/action" status: 200 len: 33293 microversion: 2.20 time: 0.162024 May 26 14:59:13.635176 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 127/263] 10.222.0.81 () {62 vars in 1319 bytes} [Wed May 26 14:59:13 2021] POST /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984/action => generated 33293 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 26 14:59:13.639457 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-bfc8d9a5-7660-4510-a5b2-b96223084551 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:59:13.640460 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-bfc8d9a5-7660-4510-a5b2-b96223084551 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: a9d8f9a6-bd66-4caa-8662-4bb94655ae59] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:13.648938 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-bfc8d9a5-7660-4510-a5b2-b96223084551 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:13.649395 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-bfc8d9a5-7660-4510-a5b2-b96223084551 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:13.650223 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-bfc8d9a5-7660-4510-a5b2-b96223084551 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:13.650670 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-bfc8d9a5-7660-4510-a5b2-b96223084551 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:13.773508 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-bfc8d9a5-7660-4510-a5b2-b96223084551 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "POST /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59/action" status: 200 len: 38168 microversion: 2.1 time: 0.137586 May 26 14:59:13.774579 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 128/264] 10.222.0.81 () {60 vars in 1278 bytes} [Wed May 26 14:59:13 2021] POST /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59/action => generated 38168 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 14:59:13.792743 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-9b72f2e0-18c4-472a-b185-9bcb1ff4613f tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:59:13.794219 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-9b72f2e0-18c4-472a-b185-9bcb1ff4613f tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] [instance: 990431e1-82cb-42b0-a288-949d79e21762] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:13.809502 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-9b72f2e0-18c4-472a-b185-9bcb1ff4613f tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:13.811140 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-9b72f2e0-18c4-472a-b185-9bcb1ff4613f tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:13.812369 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-9b72f2e0-18c4-472a-b185-9bcb1ff4613f tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:13.813736 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-9b72f2e0-18c4-472a-b185-9bcb1ff4613f tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:13.902165 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-a0083d27-5e66-482f-a8be-dc98284e83b1 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b167942c895345b186a3eda5c82175b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad2ab2705ca479ab4aaafe7c80de162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:59:13.912347 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-a0083d27-5e66-482f-a8be-dc98284e83b1 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /compute/v2.1/servers/aa145a33-41b1-4e39-9642-132aca11fcfe" status: 200 len: 1521 microversion: 2.1 time: 0.398264 May 26 14:59:13.913200 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 137/265] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:59:13 2021] GET /compute/v2.1/servers/aa145a33-41b1-4e39-9642-132aca11fcfe => generated 1521 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 14:59:13.965093 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-9b72f2e0-18c4-472a-b185-9bcb1ff4613f tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8604f942d44fec96828cc0b1ae5960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b729993a1944061bb0a708877c95a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:59:13.974794 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-9b72f2e0-18c4-472a-b185-9bcb1ff4613f tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] 10.222.0.81 "GET /compute/v2.1/servers/990431e1-82cb-42b0-a288-949d79e21762" status: 200 len: 1271 microversion: 2.1 time: 0.188257 May 26 14:59:13.975372 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 129/266] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:59:13 2021] GET /compute/v2.1/servers/990431e1-82cb-42b0-a288-949d79e21762 => generated 1271 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 14:59:14.269453 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-5e6657b6-e4f9-46b3-ba72-b2b010f9a0ee tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:59:14.270112 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-5e6657b6-e4f9-46b3-ba72-b2b010f9a0ee tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] [instance: 9357694b-0ef8-4988-9fd0-f795855f9a99] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:14.278379 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-5e6657b6-e4f9-46b3-ba72-b2b010f9a0ee tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:14.279457 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-5e6657b6-e4f9-46b3-ba72-b2b010f9a0ee tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:14.279626 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-5e6657b6-e4f9-46b3-ba72-b2b010f9a0ee tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:14.280050 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-5e6657b6-e4f9-46b3-ba72-b2b010f9a0ee tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:14.646348 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-8faf3edc-3b2c-44e2-9ec5-1e9146cfedaf tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:59:14.647320 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-8faf3edc-3b2c-44e2-9ec5-1e9146cfedaf tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 598b0e3f-8cf1-451a-80a8-ed7e5dd36984] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:14.655148 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-8faf3edc-3b2c-44e2-9ec5-1e9146cfedaf tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:14.663511 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-8faf3edc-3b2c-44e2-9ec5-1e9146cfedaf tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:14.663511 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-8faf3edc-3b2c-44e2-9ec5-1e9146cfedaf tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:14.663511 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-8faf3edc-3b2c-44e2-9ec5-1e9146cfedaf tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:14.842107 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-5e6657b6-e4f9-46b3-ba72-b2b010f9a0ee tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9e511074f445b09a3691e3328bee34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4d985046c34c1eb9e28915d7ebb5b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:59:14.854476 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-5e6657b6-e4f9-46b3-ba72-b2b010f9a0ee tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] 10.222.0.81 "GET /compute/v2.1/servers/9357694b-0ef8-4988-9fd0-f795855f9a99" status: 200 len: 1315 microversion: 2.1 time: 0.590329 May 26 14:59:14.855885 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 138/267] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:59:14 2021] GET /compute/v2.1/servers/9357694b-0ef8-4988-9fd0-f795855f9a99 => generated 1315 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:59:14.866360 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-d8671505-8004-498e-8a7d-9d490d505daf tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:59:14.868290 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-d8671505-8004-498e-8a7d-9d490d505daf tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: a9d8f9a6-bd66-4caa-8662-4bb94655ae59] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:14.880033 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-d8671505-8004-498e-8a7d-9d490d505daf tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:14.880747 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-d8671505-8004-498e-8a7d-9d490d505daf tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:14.881825 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-d8671505-8004-498e-8a7d-9d490d505daf tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:14.882429 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-d8671505-8004-498e-8a7d-9d490d505daf tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:17.848289 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-8faf3edc-3b2c-44e2-9ec5-1e9146cfedaf tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "POST /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984/action" status: 200 len: 36171 microversion: 2.20 time: 3.205652 May 26 14:59:17.848946 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 130/268] 10.222.0.81 () {62 vars in 1319 bytes} [Wed May 26 14:59:14 2021] POST /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984/action => generated 36171 bytes in 3208 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 26 14:59:17.853863 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-9b5c3084-1934-486a-8fc4-4fcd5caf6b28 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:59:17.854728 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-9b5c3084-1934-486a-8fc4-4fcd5caf6b28 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] [instance: aa145a33-41b1-4e39-9642-132aca11fcfe] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:17.863663 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-9b5c3084-1934-486a-8fc4-4fcd5caf6b28 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:17.864185 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-9b5c3084-1934-486a-8fc4-4fcd5caf6b28 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:17.864976 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-9b5c3084-1934-486a-8fc4-4fcd5caf6b28 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:17.865418 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-9b5c3084-1934-486a-8fc4-4fcd5caf6b28 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:17.885208 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-d8671505-8004-498e-8a7d-9d490d505daf tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "POST /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59/action" status: 200 len: 38299 microversion: 2.1 time: 3.027838 May 26 14:59:17.891517 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 139/269] 10.222.0.81 () {60 vars in 1278 bytes} [Wed May 26 14:59:14 2021] POST /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59/action => generated 38299 bytes in 3030 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 14:59:17.896423 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-c18aa034-d2b2-4ed1-baff-e9dde9dbccf8 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:59:17.897222 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-c18aa034-d2b2-4ed1-baff-e9dde9dbccf8 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] [instance: 990431e1-82cb-42b0-a288-949d79e21762] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:17.907124 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-c18aa034-d2b2-4ed1-baff-e9dde9dbccf8 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:17.907831 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-c18aa034-d2b2-4ed1-baff-e9dde9dbccf8 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:17.908705 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-c18aa034-d2b2-4ed1-baff-e9dde9dbccf8 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:17.909157 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-c18aa034-d2b2-4ed1-baff-e9dde9dbccf8 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:18.295719 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-9b5c3084-1934-486a-8fc4-4fcd5caf6b28 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b167942c895345b186a3eda5c82175b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad2ab2705ca479ab4aaafe7c80de162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:59:18.304829 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-9b5c3084-1934-486a-8fc4-4fcd5caf6b28 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /compute/v2.1/servers/aa145a33-41b1-4e39-9642-132aca11fcfe" status: 200 len: 1521 microversion: 2.1 time: 0.454638 May 26 14:59:18.305565 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 131/270] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:59:17 2021] GET /compute/v2.1/servers/aa145a33-41b1-4e39-9642-132aca11fcfe => generated 1521 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:59:18.310611 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [req-d8f36ee8-0dbc-4617-b379-514cd118a191 req-8768aef0-fb70-4def-be10-d0def11824a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9357694b-0ef8-4988-9fd0-f795855f9a99", "tag": "af4a6c11-6609-4623-bb2f-1fecb6f3099a"}]} {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:59:18.312403 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 14:59:18.312403 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: warnings.warn(msg) May 26 14:59:18.321809 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [req-d8f36ee8-0dbc-4617-b379-514cd118a191 req-8768aef0-fb70-4def-be10-d0def11824a3 service nova] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:18.322383 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [req-d8f36ee8-0dbc-4617-b379-514cd118a191 req-8768aef0-fb70-4def-be10-d0def11824a3 service nova] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:18.334666 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-c18aa034-d2b2-4ed1-baff-e9dde9dbccf8 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8604f942d44fec96828cc0b1ae5960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b729993a1944061bb0a708877c95a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:59:18.340706 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.compute.server_external_events [req-d8f36ee8-0dbc-4617-b379-514cd118a191 req-8768aef0-fb70-4def-be10-d0def11824a3 service nova] Creating event network-changed:af4a6c11-6609-4623-bb2f-1fecb6f3099a for instance 9357694b-0ef8-4988-9fd0-f795855f9a99 on hv-cinder-78414 May 26 14:59:18.346760 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [req-d8f36ee8-0dbc-4617-b379-514cd118a191 req-8768aef0-fb70-4def-be10-d0def11824a3 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039626 May 26 14:59:18.347617 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 132/271] 10.222.0.81 () {64 vars in 1318 bytes} [Wed May 26 14:59:18 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:59:18.353757 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-9a54cfef-4239-4ac5-801f-e271de1f5a1f tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:59:18.354754 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-9a54cfef-4239-4ac5-801f-e271de1f5a1f tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] [instance: 9357694b-0ef8-4988-9fd0-f795855f9a99] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:18.359294 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-c18aa034-d2b2-4ed1-baff-e9dde9dbccf8 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] 10.222.0.81 "GET /compute/v2.1/servers/990431e1-82cb-42b0-a288-949d79e21762" status: 200 len: 1319 microversion: 2.1 time: 0.470991 May 26 14:59:18.361585 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 140/272] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:59:17 2021] GET /compute/v2.1/servers/990431e1-82cb-42b0-a288-949d79e21762 => generated 1319 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:59:18.365844 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-9a54cfef-4239-4ac5-801f-e271de1f5a1f tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:18.366477 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-9a54cfef-4239-4ac5-801f-e271de1f5a1f tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:18.367410 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-9a54cfef-4239-4ac5-801f-e271de1f5a1f tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:18.368002 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-9a54cfef-4239-4ac5-801f-e271de1f5a1f tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:18.393500 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-05be532b-3c1b-40c5-9b3f-49e9a528f985 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:59:18.400557 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-05be532b-3c1b-40c5-9b3f-49e9a528f985 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: a9d8f9a6-bd66-4caa-8662-4bb94655ae59] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:18.422435 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-05be532b-3c1b-40c5-9b3f-49e9a528f985 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:18.423267 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-05be532b-3c1b-40c5-9b3f-49e9a528f985 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:18.424862 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-05be532b-3c1b-40c5-9b3f-49e9a528f985 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:18.425314 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-05be532b-3c1b-40c5-9b3f-49e9a528f985 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:18.533620 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-05be532b-3c1b-40c5-9b3f-49e9a528f985 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59/ips" status: 200 len: 144 microversion: 2.1 time: 0.172459 May 26 14:59:18.534397 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 141/273] 10.222.0.81 () {58 vars in 1248 bytes} [Wed May 26 14:59:18 2021] GET /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59/ips => generated 144 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:59:18.808549 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-9a54cfef-4239-4ac5-801f-e271de1f5a1f tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9e511074f445b09a3691e3328bee34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4d985046c34c1eb9e28915d7ebb5b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:59:18.818050 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-9a54cfef-4239-4ac5-801f-e271de1f5a1f tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] 10.222.0.81 "GET /compute/v2.1/servers/9357694b-0ef8-4988-9fd0-f795855f9a99" status: 200 len: 1315 microversion: 2.1 time: 0.468963 May 26 14:59:18.820105 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 133/274] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:59:18 2021] GET /compute/v2.1/servers/9357694b-0ef8-4988-9fd0-f795855f9a99 => generated 1315 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:59:18.860596 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-479c948f-6631-4fc6-b303-0084d9786de5 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:59:18.862750 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-479c948f-6631-4fc6-b303-0084d9786de5 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 598b0e3f-8cf1-451a-80a8-ed7e5dd36984] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:18.870534 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-479c948f-6631-4fc6-b303-0084d9786de5 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:18.871204 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-479c948f-6631-4fc6-b303-0084d9786de5 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:18.872369 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-479c948f-6631-4fc6-b303-0084d9786de5 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:18.872499 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-479c948f-6631-4fc6-b303-0084d9786de5 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:19.041236 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-479c948f-6631-4fc6-b303-0084d9786de5 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "POST /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984/action" status: 200 len: 36836 microversion: 2.20 time: 0.184198 May 26 14:59:19.042630 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 142/275] 10.222.0.81 () {62 vars in 1319 bytes} [Wed May 26 14:59:18 2021] POST /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984/action => generated 36836 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 26 14:59:19.214711 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [req-82784baf-5e43-473f-87bc-6892f0b83271 req-ca80d7c8-80c1-4773-89d3-63705f83a5b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "990431e1-82cb-42b0-a288-949d79e21762", "tag": "6140c9e0-a80c-4dc2-a884-ac0e5dbfdf15"}]} {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:59:19.219096 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 14:59:19.219096 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: warnings.warn(msg) May 26 14:59:19.231301 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [req-82784baf-5e43-473f-87bc-6892f0b83271 req-ca80d7c8-80c1-4773-89d3-63705f83a5b1 service nova] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:19.231755 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [req-82784baf-5e43-473f-87bc-6892f0b83271 req-ca80d7c8-80c1-4773-89d3-63705f83a5b1 service nova] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:19.249591 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.compute.server_external_events [req-82784baf-5e43-473f-87bc-6892f0b83271 req-ca80d7c8-80c1-4773-89d3-63705f83a5b1 service nova] Creating event network-changed:6140c9e0-a80c-4dc2-a884-ac0e5dbfdf15 for instance 990431e1-82cb-42b0-a288-949d79e21762 on hv-cinder-78414 May 26 14:59:19.255089 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [req-82784baf-5e43-473f-87bc-6892f0b83271 req-ca80d7c8-80c1-4773-89d3-63705f83a5b1 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048330 May 26 14:59:19.255687 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 134/276] 10.222.0.81 () {64 vars in 1318 bytes} [Wed May 26 14:59:19 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:59:19.325508 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-67dc669b-5493-4616-8b86-76e33f998ffc tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:59:19.326622 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-67dc669b-5493-4616-8b86-76e33f998ffc tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] [instance: aa145a33-41b1-4e39-9642-132aca11fcfe] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:19.334898 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-67dc669b-5493-4616-8b86-76e33f998ffc tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:19.335441 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-67dc669b-5493-4616-8b86-76e33f998ffc tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:19.336465 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-67dc669b-5493-4616-8b86-76e33f998ffc tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:19.336995 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-67dc669b-5493-4616-8b86-76e33f998ffc tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:19.376676 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-19724d3f-d2ff-48da-801b-b219e685b7ea tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:59:19.377394 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-19724d3f-d2ff-48da-801b-b219e685b7ea tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] [instance: 990431e1-82cb-42b0-a288-949d79e21762] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:19.385089 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-19724d3f-d2ff-48da-801b-b219e685b7ea tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:19.385575 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-19724d3f-d2ff-48da-801b-b219e685b7ea tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:19.386383 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-19724d3f-d2ff-48da-801b-b219e685b7ea tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:19.386832 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-19724d3f-d2ff-48da-801b-b219e685b7ea tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:19.670589 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-67dc669b-5493-4616-8b86-76e33f998ffc tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b167942c895345b186a3eda5c82175b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad2ab2705ca479ab4aaafe7c80de162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:59:19.678859 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-67dc669b-5493-4616-8b86-76e33f998ffc tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /compute/v2.1/servers/aa145a33-41b1-4e39-9642-132aca11fcfe" status: 200 len: 1521 microversion: 2.1 time: 0.358218 May 26 14:59:19.679439 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 143/277] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:59:19 2021] GET /compute/v2.1/servers/aa145a33-41b1-4e39-9642-132aca11fcfe => generated 1521 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:59:19.783736 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-19724d3f-d2ff-48da-801b-b219e685b7ea tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8604f942d44fec96828cc0b1ae5960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b729993a1944061bb0a708877c95a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:59:19.792255 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-19724d3f-d2ff-48da-801b-b219e685b7ea tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] 10.222.0.81 "GET /compute/v2.1/servers/990431e1-82cb-42b0-a288-949d79e21762" status: 200 len: 1319 microversion: 2.1 time: 0.419742 May 26 14:59:19.792826 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 135/278] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:59:19 2021] GET /compute/v2.1/servers/990431e1-82cb-42b0-a288-949d79e21762 => generated 1319 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:59:19.836415 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-d9cf6628-d7cd-44b7-b697-ec275b968489 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:59:19.837047 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-d9cf6628-d7cd-44b7-b697-ec275b968489 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] [instance: 9357694b-0ef8-4988-9fd0-f795855f9a99] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:19.844511 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-d9cf6628-d7cd-44b7-b697-ec275b968489 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:19.845520 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-d9cf6628-d7cd-44b7-b697-ec275b968489 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:19.846547 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-d9cf6628-d7cd-44b7-b697-ec275b968489 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:19.846996 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-d9cf6628-d7cd-44b7-b697-ec275b968489 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:20.055173 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-580ab5cc-cda0-4687-985d-dfa5b778075b tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:59:20.056286 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-580ab5cc-cda0-4687-985d-dfa5b778075b tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 598b0e3f-8cf1-451a-80a8-ed7e5dd36984] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:20.069832 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-580ab5cc-cda0-4687-985d-dfa5b778075b tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:20.071897 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-580ab5cc-cda0-4687-985d-dfa5b778075b tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:20.072721 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-580ab5cc-cda0-4687-985d-dfa5b778075b tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:20.073171 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-580ab5cc-cda0-4687-985d-dfa5b778075b tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:20.073840 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-d9cf6628-d7cd-44b7-b697-ec275b968489 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9e511074f445b09a3691e3328bee34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4d985046c34c1eb9e28915d7ebb5b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:59:20.086438 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-d9cf6628-d7cd-44b7-b697-ec275b968489 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] 10.222.0.81 "GET /compute/v2.1/servers/9357694b-0ef8-4988-9fd0-f795855f9a99" status: 200 len: 1315 microversion: 2.1 time: 0.253810 May 26 14:59:20.102208 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 144/279] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:59:19 2021] GET /compute/v2.1/servers/9357694b-0ef8-4988-9fd0-f795855f9a99 => generated 1315 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:59:20.209650 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-543b6b46-4e10-40f0-bc27-92467df9bba5 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-333272157", "imageRef": "dcacad62-e278-4869-aa20-e5df07dd03db", "flavorRef": "452", "networks": [{"uuid": "5bdb145e-267b-43cd-9426-f92f373c5ed5"}]}} {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:59:20.274577 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.network.neutron [None req-543b6b46-4e10-40f0-bc27-92467df9bba5 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] validate_networks() for [('5bdb145e-267b-43cd-9426-f92f373c5ed5', None, None, None)] {{(pid=118513) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} May 26 14:59:20.865801 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.virt.hardware [None req-543b6b46-4e10-40f0-bc27-92467df9bba5 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Flavor limits 0:0:0 {{(pid=118513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} May 26 14:59:20.866235 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.virt.hardware [None req-543b6b46-4e10-40f0-bc27-92467df9bba5 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Image limits 0:0:0 {{(pid=118513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} May 26 14:59:20.866721 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.virt.hardware [None req-543b6b46-4e10-40f0-bc27-92467df9bba5 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Flavor pref 0:0:0 {{(pid=118513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} May 26 14:59:20.867138 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.virt.hardware [None req-543b6b46-4e10-40f0-bc27-92467df9bba5 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Image pref 0:0:0 {{(pid=118513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} May 26 14:59:20.867557 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.virt.hardware [None req-543b6b46-4e10-40f0-bc27-92467df9bba5 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} May 26 14:59:20.876181 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-543b6b46-4e10-40f0-bc27-92467df9bba5 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:20.877188 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-543b6b46-4e10-40f0-bc27-92467df9bba5 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:20.878180 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-543b6b46-4e10-40f0-bc27-92467df9bba5 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:20.878623 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-543b6b46-4e10-40f0-bc27-92467df9bba5 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:20.896103 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.quota [None req-543b6b46-4e10-40f0-bc27-92467df9bba5 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Getting quotas for project 1515325707f64d58a28f26451b2c74de. Resources: {'instances', 'ram', 'cores'} {{(pid=118513) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 26 14:59:20.900194 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.quota [None req-543b6b46-4e10-40f0-bc27-92467df9bba5 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Getting quotas for user 1be4bd5c0f2a400da491bae101b48832 and project 1515325707f64d58a28f26451b2c74de. Resources: {'instances', 'ram', 'cores'} {{(pid=118513) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 26 14:59:20.911221 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-543b6b46-4e10-40f0-bc27-92467df9bba5 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Going to run 1 instances... {{(pid=118513) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 26 14:59:20.913505 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-543b6b46-4e10-40f0-bc27-92467df9bba5 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] [instance: 811eac08-9039-4d9e-a76f-fa4d6033f5a6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dcacad62-e278-4869-aa20-e5df07dd03db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118513) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} May 26 14:59:21.068239 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-543b6b46-4e10-40f0-bc27-92467df9bba5 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.862248 May 26 14:59:21.068833 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 145/280] 10.222.0.81 () {60 vars in 1147 bytes} [Wed May 26 14:59:20 2021] POST /compute/v2.1/servers => generated 380 bytes in 864 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 26 14:59:21.073197 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-9bca7322-5e17-4f76-b15b-442774951d07 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:59:21.073843 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-9bca7322-5e17-4f76-b15b-442774951d07 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] [instance: aa145a33-41b1-4e39-9642-132aca11fcfe] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:21.081605 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-9bca7322-5e17-4f76-b15b-442774951d07 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:21.082207 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-9bca7322-5e17-4f76-b15b-442774951d07 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:21.082909 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-9bca7322-5e17-4f76-b15b-442774951d07 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:21.083489 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-9bca7322-5e17-4f76-b15b-442774951d07 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:21.293271 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-9bca7322-5e17-4f76-b15b-442774951d07 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b167942c895345b186a3eda5c82175b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad2ab2705ca479ab4aaafe7c80de162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:59:21.302329 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-9bca7322-5e17-4f76-b15b-442774951d07 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /compute/v2.1/servers/aa145a33-41b1-4e39-9642-132aca11fcfe" status: 200 len: 1521 microversion: 2.1 time: 0.232448 May 26 14:59:21.302905 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 146/281] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:59:21 2021] GET /compute/v2.1/servers/aa145a33-41b1-4e39-9642-132aca11fcfe => generated 1521 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:59:21.307201 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-0a65ccfb-b231-4dcf-a2c0-a96039aed16d tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:59:21.307932 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-0a65ccfb-b231-4dcf-a2c0-a96039aed16d tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] [instance: 990431e1-82cb-42b0-a288-949d79e21762] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:21.315033 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-0a65ccfb-b231-4dcf-a2c0-a96039aed16d tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:21.315495 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-0a65ccfb-b231-4dcf-a2c0-a96039aed16d tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:21.316271 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-0a65ccfb-b231-4dcf-a2c0-a96039aed16d tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:21.316714 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-0a65ccfb-b231-4dcf-a2c0-a96039aed16d tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:21.511924 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-0a65ccfb-b231-4dcf-a2c0-a96039aed16d tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8604f942d44fec96828cc0b1ae5960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b729993a1944061bb0a708877c95a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:59:21.521025 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-0a65ccfb-b231-4dcf-a2c0-a96039aed16d tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] 10.222.0.81 "GET /compute/v2.1/servers/990431e1-82cb-42b0-a288-949d79e21762" status: 200 len: 1319 microversion: 2.1 time: 0.217118 May 26 14:59:21.521614 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 147/282] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:59:21 2021] GET /compute/v2.1/servers/990431e1-82cb-42b0-a288-949d79e21762 => generated 1319 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:59:21.525982 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-85ac7bc3-ec3e-49f3-8f0f-d6f013b31415 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:59:21.526553 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-85ac7bc3-ec3e-49f3-8f0f-d6f013b31415 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] [instance: 811eac08-9039-4d9e-a76f-fa4d6033f5a6] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:21.601188 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-85ac7bc3-ec3e-49f3-8f0f-d6f013b31415 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be4bd5c0f2a400da491bae101b48832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515325707f64d58a28f26451b2c74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:59:21.608819 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-85ac7bc3-ec3e-49f3-8f0f-d6f013b31415 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /compute/v2.1/servers/811eac08-9039-4d9e-a76f-fa4d6033f5a6" status: 200 len: 1217 microversion: 2.1 time: 0.086202 May 26 14:59:21.609392 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 148/283] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:59:21 2021] GET /compute/v2.1/servers/811eac08-9039-4d9e-a76f-fa4d6033f5a6 => generated 1217 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:59:21.614054 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-da1483af-526b-4969-aba7-1ce1801e5660 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:59:21.614664 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-da1483af-526b-4969-aba7-1ce1801e5660 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] [instance: 9357694b-0ef8-4988-9fd0-f795855f9a99] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:21.624312 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-da1483af-526b-4969-aba7-1ce1801e5660 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:21.624312 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-da1483af-526b-4969-aba7-1ce1801e5660 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:21.624312 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-da1483af-526b-4969-aba7-1ce1801e5660 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:21.624312 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-da1483af-526b-4969-aba7-1ce1801e5660 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:21.821196 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-da1483af-526b-4969-aba7-1ce1801e5660 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9e511074f445b09a3691e3328bee34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4d985046c34c1eb9e28915d7ebb5b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:59:21.830839 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-da1483af-526b-4969-aba7-1ce1801e5660 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] 10.222.0.81 "GET /compute/v2.1/servers/9357694b-0ef8-4988-9fd0-f795855f9a99" status: 200 len: 1315 microversion: 2.1 time: 0.219116 May 26 14:59:21.831244 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 149/284] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:59:21 2021] GET /compute/v2.1/servers/9357694b-0ef8-4988-9fd0-f795855f9a99 => generated 1315 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:59:22.320862 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-5dc0a129-c79f-463a-a65e-101df12c5230 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:59:22.321769 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-5dc0a129-c79f-463a-a65e-101df12c5230 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] [instance: aa145a33-41b1-4e39-9642-132aca11fcfe] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:22.329949 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-5dc0a129-c79f-463a-a65e-101df12c5230 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:22.330505 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-5dc0a129-c79f-463a-a65e-101df12c5230 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:22.331280 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-5dc0a129-c79f-463a-a65e-101df12c5230 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:22.331724 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-5dc0a129-c79f-463a-a65e-101df12c5230 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:22.540817 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-5dc0a129-c79f-463a-a65e-101df12c5230 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b167942c895345b186a3eda5c82175b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad2ab2705ca479ab4aaafe7c80de162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:59:22.549010 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-5dc0a129-c79f-463a-a65e-101df12c5230 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /compute/v2.1/servers/aa145a33-41b1-4e39-9642-132aca11fcfe" status: 200 len: 1521 microversion: 2.1 time: 0.231886 May 26 14:59:22.549593 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 150/285] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:59:22 2021] GET /compute/v2.1/servers/aa145a33-41b1-4e39-9642-132aca11fcfe => generated 1521 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 14:59:22.553750 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-b37afa09-9551-4cc7-b24a-477e978611ad tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:59:22.554364 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-b37afa09-9551-4cc7-b24a-477e978611ad tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] [instance: 990431e1-82cb-42b0-a288-949d79e21762] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:22.561076 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-b37afa09-9551-4cc7-b24a-477e978611ad tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:22.561530 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-b37afa09-9551-4cc7-b24a-477e978611ad tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:22.562321 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-b37afa09-9551-4cc7-b24a-477e978611ad tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:22.562759 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-b37afa09-9551-4cc7-b24a-477e978611ad tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:22.757211 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-b37afa09-9551-4cc7-b24a-477e978611ad tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8604f942d44fec96828cc0b1ae5960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b729993a1944061bb0a708877c95a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:59:22.765809 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-b37afa09-9551-4cc7-b24a-477e978611ad tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] 10.222.0.81 "GET /compute/v2.1/servers/990431e1-82cb-42b0-a288-949d79e21762" status: 200 len: 1319 microversion: 2.1 time: 0.215077 May 26 14:59:22.766434 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 151/286] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:59:22 2021] GET /compute/v2.1/servers/990431e1-82cb-42b0-a288-949d79e21762 => generated 1319 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:59:22.778770 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-dca459b5-2610-47c4-8de0-40ebce8ceed1 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:59:22.779705 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-dca459b5-2610-47c4-8de0-40ebce8ceed1 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] [instance: 811eac08-9039-4d9e-a76f-fa4d6033f5a6] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:22.789686 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-dca459b5-2610-47c4-8de0-40ebce8ceed1 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:22.790222 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-dca459b5-2610-47c4-8de0-40ebce8ceed1 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:22.791186 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-dca459b5-2610-47c4-8de0-40ebce8ceed1 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:22.791617 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-dca459b5-2610-47c4-8de0-40ebce8ceed1 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:22.806815 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-580ab5cc-cda0-4687-985d-dfa5b778075b tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "POST /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984/action" status: 200 len: 38208 microversion: 2.20 time: 2.756013 May 26 14:59:22.812163 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 136/287] 10.222.0.81 () {62 vars in 1319 bytes} [Wed May 26 14:59:20 2021] POST /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984/action => generated 38208 bytes in 2762 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 26 14:59:22.851397 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-017b83fa-e593-4ce1-9103-2195acf95a2f tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:59:22.852501 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-017b83fa-e593-4ce1-9103-2195acf95a2f tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] [instance: 9357694b-0ef8-4988-9fd0-f795855f9a99] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:22.863092 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-017b83fa-e593-4ce1-9103-2195acf95a2f tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:22.863549 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-017b83fa-e593-4ce1-9103-2195acf95a2f tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:22.864504 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-017b83fa-e593-4ce1-9103-2195acf95a2f tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:22.865551 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-017b83fa-e593-4ce1-9103-2195acf95a2f tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:22.931708 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-dca459b5-2610-47c4-8de0-40ebce8ceed1 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be4bd5c0f2a400da491bae101b48832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515325707f64d58a28f26451b2c74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:59:22.946842 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-dca459b5-2610-47c4-8de0-40ebce8ceed1 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /compute/v2.1/servers/811eac08-9039-4d9e-a76f-fa4d6033f5a6" status: 200 len: 1221 microversion: 2.1 time: 0.173336 May 26 14:59:22.959096 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 152/288] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:59:22 2021] GET /compute/v2.1/servers/811eac08-9039-4d9e-a76f-fa4d6033f5a6 => generated 1221 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:59:23.304232 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-017b83fa-e593-4ce1-9103-2195acf95a2f tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9e511074f445b09a3691e3328bee34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4d985046c34c1eb9e28915d7ebb5b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:59:23.312689 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-017b83fa-e593-4ce1-9103-2195acf95a2f tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] 10.222.0.81 "GET /compute/v2.1/servers/9357694b-0ef8-4988-9fd0-f795855f9a99" status: 200 len: 1315 microversion: 2.1 time: 0.468844 May 26 14:59:23.313262 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 137/289] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:59:22 2021] GET /compute/v2.1/servers/9357694b-0ef8-4988-9fd0-f795855f9a99 => generated 1315 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 14:59:23.566505 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-d9e472f9-c741-4943-a7b7-f1921c9b62bf tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:59:23.567121 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-d9e472f9-c741-4943-a7b7-f1921c9b62bf tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] [instance: aa145a33-41b1-4e39-9642-132aca11fcfe] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:23.575031 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-d9e472f9-c741-4943-a7b7-f1921c9b62bf tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:23.575476 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-d9e472f9-c741-4943-a7b7-f1921c9b62bf tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:23.576256 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-d9e472f9-c741-4943-a7b7-f1921c9b62bf tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:23.576702 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-d9e472f9-c741-4943-a7b7-f1921c9b62bf tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:23.783448 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-3971be24-cefd-4b77-b319-ac9d9152b730 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:59:23.784098 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-3971be24-cefd-4b77-b319-ac9d9152b730 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] [instance: 990431e1-82cb-42b0-a288-949d79e21762] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:23.784783 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-d9e472f9-c741-4943-a7b7-f1921c9b62bf tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b167942c895345b186a3eda5c82175b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad2ab2705ca479ab4aaafe7c80de162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:59:23.791671 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-3971be24-cefd-4b77-b319-ac9d9152b730 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:23.792123 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-3971be24-cefd-4b77-b319-ac9d9152b730 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:23.792898 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-3971be24-cefd-4b77-b319-ac9d9152b730 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:23.792996 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-d9e472f9-c741-4943-a7b7-f1921c9b62bf tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /compute/v2.1/servers/aa145a33-41b1-4e39-9642-132aca11fcfe" status: 200 len: 1521 microversion: 2.1 time: 0.231048 May 26 14:59:23.793340 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-3971be24-cefd-4b77-b319-ac9d9152b730 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:23.795607 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 153/290] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:59:23 2021] GET /compute/v2.1/servers/aa145a33-41b1-4e39-9642-132aca11fcfe => generated 1521 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:59:23.820494 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-7ca7d9f9-d11e-4572-8cde-b22ebd12a8f7 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:59:23.821497 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-7ca7d9f9-d11e-4572-8cde-b22ebd12a8f7 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 598b0e3f-8cf1-451a-80a8-ed7e5dd36984] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:23.828842 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-7ca7d9f9-d11e-4572-8cde-b22ebd12a8f7 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:23.829319 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-7ca7d9f9-d11e-4572-8cde-b22ebd12a8f7 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:23.831046 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-7ca7d9f9-d11e-4572-8cde-b22ebd12a8f7 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:23.831505 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-7ca7d9f9-d11e-4572-8cde-b22ebd12a8f7 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:23.941195 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-7ca7d9f9-d11e-4572-8cde-b22ebd12a8f7 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "POST /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984/action" status: 200 len: 38211 microversion: 2.20 time: 0.123999 May 26 14:59:23.941813 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 154/291] 10.222.0.81 () {62 vars in 1319 bytes} [Wed May 26 14:59:23 2021] POST /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984/action => generated 38211 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 26 14:59:23.966703 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-ba5cd242-0ced-410c-b5f7-66dda03078e8 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:59:23.967444 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-ba5cd242-0ced-410c-b5f7-66dda03078e8 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] [instance: 811eac08-9039-4d9e-a76f-fa4d6033f5a6] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:23.975818 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-ba5cd242-0ced-410c-b5f7-66dda03078e8 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:23.976280 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-ba5cd242-0ced-410c-b5f7-66dda03078e8 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:23.977200 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-ba5cd242-0ced-410c-b5f7-66dda03078e8 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:23.977607 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-ba5cd242-0ced-410c-b5f7-66dda03078e8 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:24.005848 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-3971be24-cefd-4b77-b319-ac9d9152b730 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8604f942d44fec96828cc0b1ae5960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b729993a1944061bb0a708877c95a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:59:24.015364 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-3971be24-cefd-4b77-b319-ac9d9152b730 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] 10.222.0.81 "GET /compute/v2.1/servers/990431e1-82cb-42b0-a288-949d79e21762" status: 200 len: 1319 microversion: 2.1 time: 0.236240 May 26 14:59:24.015942 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 138/292] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:59:23 2021] GET /compute/v2.1/servers/990431e1-82cb-42b0-a288-949d79e21762 => generated 1319 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 14:59:24.086277 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-170eae0c-4336-486b-b8a1-b4ffa2397d35 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "705c57c3-af0e-4cd0-a8f5-87e26e7706cf"}} {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:59:24.087385 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-170eae0c-4336-486b-b8a1-b4ffa2397d35 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: a9d8f9a6-bd66-4caa-8662-4bb94655ae59] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:24.094822 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-170eae0c-4336-486b-b8a1-b4ffa2397d35 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:24.096463 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-170eae0c-4336-486b-b8a1-b4ffa2397d35 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:24.096592 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-ba5cd242-0ced-410c-b5f7-66dda03078e8 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be4bd5c0f2a400da491bae101b48832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515325707f64d58a28f26451b2c74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:59:24.096705 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-170eae0c-4336-486b-b8a1-b4ffa2397d35 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:24.096705 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-170eae0c-4336-486b-b8a1-b4ffa2397d35 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:24.104347 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-ba5cd242-0ced-410c-b5f7-66dda03078e8 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /compute/v2.1/servers/811eac08-9039-4d9e-a76f-fa4d6033f5a6" status: 200 len: 1269 microversion: 2.1 time: 0.142159 May 26 14:59:24.105137 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 155/293] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:59:23 2021] GET /compute/v2.1/servers/811eac08-9039-4d9e-a76f-fa4d6033f5a6 => generated 1269 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 14:59:24.329816 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-c96ec967-45a2-4438-b854-7cfb2ec9459e tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:59:24.330431 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-c96ec967-45a2-4438-b854-7cfb2ec9459e tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] [instance: 9357694b-0ef8-4988-9fd0-f795855f9a99] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:24.337927 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-c96ec967-45a2-4438-b854-7cfb2ec9459e tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:24.343174 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-c96ec967-45a2-4438-b854-7cfb2ec9459e tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:24.343174 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-c96ec967-45a2-4438-b854-7cfb2ec9459e tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:24.343174 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-c96ec967-45a2-4438-b854-7cfb2ec9459e tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:24.545439 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-c96ec967-45a2-4438-b854-7cfb2ec9459e tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9e511074f445b09a3691e3328bee34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4d985046c34c1eb9e28915d7ebb5b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:59:24.554044 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-c96ec967-45a2-4438-b854-7cfb2ec9459e tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] 10.222.0.81 "GET /compute/v2.1/servers/9357694b-0ef8-4988-9fd0-f795855f9a99" status: 200 len: 1315 microversion: 2.1 time: 0.228076 May 26 14:59:24.554935 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 156/294] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:59:24 2021] GET /compute/v2.1/servers/9357694b-0ef8-4988-9fd0-f795855f9a99 => generated 1315 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 14:59:24.813496 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-de429c03-87b9-4c37-817b-b4984f0894cb tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:59:24.815147 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-de429c03-87b9-4c37-817b-b4984f0894cb tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] [instance: aa145a33-41b1-4e39-9642-132aca11fcfe] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:24.825062 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-de429c03-87b9-4c37-817b-b4984f0894cb tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:24.825649 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-de429c03-87b9-4c37-817b-b4984f0894cb tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:24.826561 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-de429c03-87b9-4c37-817b-b4984f0894cb tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:24.827072 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-de429c03-87b9-4c37-817b-b4984f0894cb tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:25.052258 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-de429c03-87b9-4c37-817b-b4984f0894cb tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b167942c895345b186a3eda5c82175b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad2ab2705ca479ab4aaafe7c80de162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:59:25.061068 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-de429c03-87b9-4c37-817b-b4984f0894cb tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /compute/v2.1/servers/aa145a33-41b1-4e39-9642-132aca11fcfe" status: 200 len: 1521 microversion: 2.1 time: 0.252874 May 26 14:59:25.061704 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 157/295] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:59:24 2021] GET /compute/v2.1/servers/aa145a33-41b1-4e39-9642-132aca11fcfe => generated 1521 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 14:59:25.067195 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-d68c2b22-1a3e-4cfb-98a4-0ee7393b607c tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:59:25.068203 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-d68c2b22-1a3e-4cfb-98a4-0ee7393b607c tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 598b0e3f-8cf1-451a-80a8-ed7e5dd36984] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:25.075626 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-d68c2b22-1a3e-4cfb-98a4-0ee7393b607c tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:25.076133 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-d68c2b22-1a3e-4cfb-98a4-0ee7393b607c tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:25.076872 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-d68c2b22-1a3e-4cfb-98a4-0ee7393b607c tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:25.077320 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-d68c2b22-1a3e-4cfb-98a4-0ee7393b607c tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:25.191370 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-d68c2b22-1a3e-4cfb-98a4-0ee7393b607c tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "POST /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984/action" status: 200 len: 38348 microversion: 2.20 time: 0.128116 May 26 14:59:25.192817 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 158/296] 10.222.0.81 () {62 vars in 1319 bytes} [Wed May 26 14:59:25 2021] POST /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984/action => generated 38348 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 26 14:59:25.197067 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-1eb32fbb-bf2d-4c68-80c6-11d2ec309fa8 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:59:25.197792 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-1eb32fbb-bf2d-4c68-80c6-11d2ec309fa8 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] [instance: 990431e1-82cb-42b0-a288-949d79e21762] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:25.207475 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-1eb32fbb-bf2d-4c68-80c6-11d2ec309fa8 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:25.207935 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-1eb32fbb-bf2d-4c68-80c6-11d2ec309fa8 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:25.208735 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-1eb32fbb-bf2d-4c68-80c6-11d2ec309fa8 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:25.209184 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-1eb32fbb-bf2d-4c68-80c6-11d2ec309fa8 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:25.224357 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-170eae0c-4336-486b-b8a1-b4ffa2397d35 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "POST /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.141643 May 26 14:59:25.256347 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 139/297] 10.222.0.81 () {60 vars in 1323 bytes} [Wed May 26 14:59:24 2021] POST /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59/os-volume_attachments => generated 194 bytes in 1175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 14:59:25.262881 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-7506d7d9-6ed9-41d9-a597-a836b30dff8b tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:59:25.263876 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-7506d7d9-6ed9-41d9-a597-a836b30dff8b tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] [instance: 811eac08-9039-4d9e-a76f-fa4d6033f5a6] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:25.273575 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-7506d7d9-6ed9-41d9-a597-a836b30dff8b tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:25.274394 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-7506d7d9-6ed9-41d9-a597-a836b30dff8b tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:25.275367 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-7506d7d9-6ed9-41d9-a597-a836b30dff8b tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:25.275959 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-7506d7d9-6ed9-41d9-a597-a836b30dff8b tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:25.458176 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-1eb32fbb-bf2d-4c68-80c6-11d2ec309fa8 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8604f942d44fec96828cc0b1ae5960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b729993a1944061bb0a708877c95a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:59:25.466400 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-1eb32fbb-bf2d-4c68-80c6-11d2ec309fa8 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] 10.222.0.81 "GET /compute/v2.1/servers/990431e1-82cb-42b0-a288-949d79e21762" status: 200 len: 1319 microversion: 2.1 time: 0.273159 May 26 14:59:25.475862 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 159/298] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:59:25 2021] GET /compute/v2.1/servers/990431e1-82cb-42b0-a288-949d79e21762 => generated 1319 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:59:25.475862 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-3d3f7ac2-b2af-4f5c-854e-fe8a6553f97b tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:59:25.475862 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-3d3f7ac2-b2af-4f5c-854e-fe8a6553f97b tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 598b0e3f-8cf1-451a-80a8-ed7e5dd36984] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:25.479206 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-3d3f7ac2-b2af-4f5c-854e-fe8a6553f97b tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:25.479743 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-3d3f7ac2-b2af-4f5c-854e-fe8a6553f97b tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:25.492455 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-3d3f7ac2-b2af-4f5c-854e-fe8a6553f97b tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:25.492455 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-3d3f7ac2-b2af-4f5c-854e-fe8a6553f97b tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:25.550266 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-3d3f7ac2-b2af-4f5c-854e-fe8a6553f97b tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984/ips" status: 200 len: 152 microversion: 2.20 time: 0.082185 May 26 14:59:25.555833 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 160/299] 10.222.0.81 () {60 vars in 1289 bytes} [Wed May 26 14:59:25 2021] GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984/ips => generated 152 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 14:59:25.572100 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-664e2272-271b-43a7-a0fb-9455893fa069 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:59:25.573401 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-664e2272-271b-43a7-a0fb-9455893fa069 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] [instance: 9357694b-0ef8-4988-9fd0-f795855f9a99] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:25.586434 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-664e2272-271b-43a7-a0fb-9455893fa069 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:25.588066 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-664e2272-271b-43a7-a0fb-9455893fa069 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:25.588929 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-664e2272-271b-43a7-a0fb-9455893fa069 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:25.595815 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-664e2272-271b-43a7-a0fb-9455893fa069 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:25.774574 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-7506d7d9-6ed9-41d9-a597-a836b30dff8b tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be4bd5c0f2a400da491bae101b48832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515325707f64d58a28f26451b2c74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:59:25.787495 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-7506d7d9-6ed9-41d9-a597-a836b30dff8b tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /compute/v2.1/servers/811eac08-9039-4d9e-a76f-fa4d6033f5a6" status: 200 len: 1317 microversion: 2.1 time: 0.528507 May 26 14:59:25.788440 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 140/300] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:59:25 2021] GET /compute/v2.1/servers/811eac08-9039-4d9e-a76f-fa4d6033f5a6 => generated 1317 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:59:25.861035 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-664e2272-271b-43a7-a0fb-9455893fa069 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9e511074f445b09a3691e3328bee34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4d985046c34c1eb9e28915d7ebb5b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:59:25.871623 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-664e2272-271b-43a7-a0fb-9455893fa069 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] 10.222.0.81 "GET /compute/v2.1/servers/9357694b-0ef8-4988-9fd0-f795855f9a99" status: 200 len: 1315 microversion: 2.1 time: 0.302744 May 26 14:59:25.872669 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 161/301] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:59:25 2021] GET /compute/v2.1/servers/9357694b-0ef8-4988-9fd0-f795855f9a99 => generated 1315 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:59:26.079102 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-a2ce38fe-95fb-4c80-827e-e23f03534b75 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:59:26.080713 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-a2ce38fe-95fb-4c80-827e-e23f03534b75 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] [instance: aa145a33-41b1-4e39-9642-132aca11fcfe] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:26.089655 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-a2ce38fe-95fb-4c80-827e-e23f03534b75 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:26.090174 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-a2ce38fe-95fb-4c80-827e-e23f03534b75 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:26.090962 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-a2ce38fe-95fb-4c80-827e-e23f03534b75 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:26.091611 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-a2ce38fe-95fb-4c80-827e-e23f03534b75 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:26.464983 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-a2ce38fe-95fb-4c80-827e-e23f03534b75 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b167942c895345b186a3eda5c82175b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad2ab2705ca479ab4aaafe7c80de162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:59:26.474810 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-a2ce38fe-95fb-4c80-827e-e23f03534b75 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /compute/v2.1/servers/aa145a33-41b1-4e39-9642-132aca11fcfe" status: 200 len: 1521 microversion: 2.1 time: 0.399577 May 26 14:59:26.476309 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 141/302] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:59:26 2021] GET /compute/v2.1/servers/aa145a33-41b1-4e39-9642-132aca11fcfe => generated 1521 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:59:26.483688 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-1d44f6c2-b264-451e-bcfd-80fb736c16e7 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:59:26.484312 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-1d44f6c2-b264-451e-bcfd-80fb736c16e7 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] [instance: 990431e1-82cb-42b0-a288-949d79e21762] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:26.494414 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-1d44f6c2-b264-451e-bcfd-80fb736c16e7 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:26.494886 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-1d44f6c2-b264-451e-bcfd-80fb736c16e7 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:26.495838 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-1d44f6c2-b264-451e-bcfd-80fb736c16e7 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:26.496812 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-1d44f6c2-b264-451e-bcfd-80fb736c16e7 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:26.804048 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-9ce37cea-86d5-4cf6-8002-fac6cdf9afad tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:59:26.804664 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-9ce37cea-86d5-4cf6-8002-fac6cdf9afad tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] [instance: 811eac08-9039-4d9e-a76f-fa4d6033f5a6] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:26.824191 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-1d44f6c2-b264-451e-bcfd-80fb736c16e7 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8604f942d44fec96828cc0b1ae5960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b729993a1944061bb0a708877c95a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:59:26.824957 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-9ce37cea-86d5-4cf6-8002-fac6cdf9afad tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:26.825445 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-9ce37cea-86d5-4cf6-8002-fac6cdf9afad tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:26.826369 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-9ce37cea-86d5-4cf6-8002-fac6cdf9afad tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:26.827009 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-9ce37cea-86d5-4cf6-8002-fac6cdf9afad tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:26.833420 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-1d44f6c2-b264-451e-bcfd-80fb736c16e7 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] 10.222.0.81 "GET /compute/v2.1/servers/990431e1-82cb-42b0-a288-949d79e21762" status: 200 len: 1319 microversion: 2.1 time: 0.353764 May 26 14:59:26.834031 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 162/303] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:59:26 2021] GET /compute/v2.1/servers/990431e1-82cb-42b0-a288-949d79e21762 => generated 1319 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:59:26.886669 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [req-075b49fc-4c13-4d25-85d1-9db153092c98 req-ca54e62f-f337-4f76-b23b-38d2adc4508e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "811eac08-9039-4d9e-a76f-fa4d6033f5a6", "tag": "569fad69-3482-4ba8-829b-ffd9c0bc4482"}]} {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:59:26.888305 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 14:59:26.888305 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: warnings.warn(msg) May 26 14:59:26.898199 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [req-075b49fc-4c13-4d25-85d1-9db153092c98 req-ca54e62f-f337-4f76-b23b-38d2adc4508e service nova] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:26.898756 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [req-075b49fc-4c13-4d25-85d1-9db153092c98 req-ca54e62f-f337-4f76-b23b-38d2adc4508e service nova] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:26.919106 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.compute.server_external_events [req-075b49fc-4c13-4d25-85d1-9db153092c98 req-ca54e62f-f337-4f76-b23b-38d2adc4508e service nova] Creating event network-changed:569fad69-3482-4ba8-829b-ffd9c0bc4482 for instance 811eac08-9039-4d9e-a76f-fa4d6033f5a6 on hv-cinder-78414 May 26 14:59:26.924417 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [req-075b49fc-4c13-4d25-85d1-9db153092c98 req-ca54e62f-f337-4f76-b23b-38d2adc4508e service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041276 May 26 14:59:26.925014 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 163/304] 10.222.0.81 () {64 vars in 1318 bytes} [Wed May 26 14:59:26 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:59:26.930648 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-68ed7be2-614a-475b-bec6-fb7f595075b7 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:59:26.931588 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-68ed7be2-614a-475b-bec6-fb7f595075b7 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] [instance: 9357694b-0ef8-4988-9fd0-f795855f9a99] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:26.939727 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-68ed7be2-614a-475b-bec6-fb7f595075b7 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:26.940430 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-68ed7be2-614a-475b-bec6-fb7f595075b7 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:26.941228 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-68ed7be2-614a-475b-bec6-fb7f595075b7 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:26.942351 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-68ed7be2-614a-475b-bec6-fb7f595075b7 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:27.205881 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-68ed7be2-614a-475b-bec6-fb7f595075b7 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9e511074f445b09a3691e3328bee34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4d985046c34c1eb9e28915d7ebb5b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:59:27.214496 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-68ed7be2-614a-475b-bec6-fb7f595075b7 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] 10.222.0.81 "GET /compute/v2.1/servers/9357694b-0ef8-4988-9fd0-f795855f9a99" status: 200 len: 1315 microversion: 2.1 time: 0.288078 May 26 14:59:27.215254 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 164/305] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:59:26 2021] GET /compute/v2.1/servers/9357694b-0ef8-4988-9fd0-f795855f9a99 => generated 1315 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:59:27.218867 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-9ce37cea-86d5-4cf6-8002-fac6cdf9afad tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be4bd5c0f2a400da491bae101b48832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515325707f64d58a28f26451b2c74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:59:27.228319 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-9ce37cea-86d5-4cf6-8002-fac6cdf9afad tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /compute/v2.1/servers/811eac08-9039-4d9e-a76f-fa4d6033f5a6" status: 200 len: 1317 microversion: 2.1 time: 0.427857 May 26 14:59:27.228895 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 142/306] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:59:26 2021] GET /compute/v2.1/servers/811eac08-9039-4d9e-a76f-fa4d6033f5a6 => generated 1317 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 14:59:27.388136 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [req-cf717271-e0b1-41f6-bb1c-426da5d942dd req-46edf2ed-ca77-4278-b032-12a5b688ddc3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9357694b-0ef8-4988-9fd0-f795855f9a99", "name": "network-vif-plugged", "status": "completed", "tag": "af4a6c11-6609-4623-bb2f-1fecb6f3099a"}]} {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:59:27.390163 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 14:59:27.390163 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: warnings.warn(msg) May 26 14:59:27.399078 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [req-cf717271-e0b1-41f6-bb1c-426da5d942dd req-46edf2ed-ca77-4278-b032-12a5b688ddc3 service nova] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:27.399879 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [req-cf717271-e0b1-41f6-bb1c-426da5d942dd req-46edf2ed-ca77-4278-b032-12a5b688ddc3 service nova] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:27.417767 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.compute.server_external_events [req-cf717271-e0b1-41f6-bb1c-426da5d942dd req-46edf2ed-ca77-4278-b032-12a5b688ddc3 service nova] Creating event network-vif-plugged:af4a6c11-6609-4623-bb2f-1fecb6f3099a for instance 9357694b-0ef8-4988-9fd0-f795855f9a99 on hv-cinder-78414 May 26 14:59:27.422862 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [req-cf717271-e0b1-41f6-bb1c-426da5d942dd req-46edf2ed-ca77-4278-b032-12a5b688ddc3 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041839 May 26 14:59:27.424143 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 165/307] 10.222.0.81 () {64 vars in 1318 bytes} [Wed May 26 14:59:27 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:59:27.493201 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-acf2084a-e8e9-4d68-8d4a-d194a1d45e7a tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:59:27.494203 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-acf2084a-e8e9-4d68-8d4a-d194a1d45e7a tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] [instance: aa145a33-41b1-4e39-9642-132aca11fcfe] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:27.509950 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-acf2084a-e8e9-4d68-8d4a-d194a1d45e7a tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:27.510432 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-acf2084a-e8e9-4d68-8d4a-d194a1d45e7a tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:27.513900 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-acf2084a-e8e9-4d68-8d4a-d194a1d45e7a tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:27.513900 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-acf2084a-e8e9-4d68-8d4a-d194a1d45e7a tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:27.854325 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-160bae89-7fcf-4860-a287-c62f818ccba5 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:59:27.856111 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-160bae89-7fcf-4860-a287-c62f818ccba5 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] [instance: 990431e1-82cb-42b0-a288-949d79e21762] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:27.866772 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-160bae89-7fcf-4860-a287-c62f818ccba5 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:27.867557 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-160bae89-7fcf-4860-a287-c62f818ccba5 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:27.868961 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-160bae89-7fcf-4860-a287-c62f818ccba5 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:27.869924 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-160bae89-7fcf-4860-a287-c62f818ccba5 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:28.054051 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-acf2084a-e8e9-4d68-8d4a-d194a1d45e7a tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b167942c895345b186a3eda5c82175b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad2ab2705ca479ab4aaafe7c80de162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:59:28.064046 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-acf2084a-e8e9-4d68-8d4a-d194a1d45e7a tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /compute/v2.1/servers/aa145a33-41b1-4e39-9642-132aca11fcfe" status: 200 len: 1521 microversion: 2.1 time: 0.573979 May 26 14:59:28.064655 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 143/308] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:59:27 2021] GET /compute/v2.1/servers/aa145a33-41b1-4e39-9642-132aca11fcfe => generated 1521 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:59:28.107878 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-160bae89-7fcf-4860-a287-c62f818ccba5 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8604f942d44fec96828cc0b1ae5960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b729993a1944061bb0a708877c95a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:59:28.116412 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-160bae89-7fcf-4860-a287-c62f818ccba5 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] 10.222.0.81 "GET /compute/v2.1/servers/990431e1-82cb-42b0-a288-949d79e21762" status: 200 len: 1319 microversion: 2.1 time: 0.268815 May 26 14:59:28.117184 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 166/309] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:59:27 2021] GET /compute/v2.1/servers/990431e1-82cb-42b0-a288-949d79e21762 => generated 1319 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:59:28.231830 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-af1bd8b7-3c45-449a-a920-457884fceb7a tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:59:28.232477 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-af1bd8b7-3c45-449a-a920-457884fceb7a tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] [instance: 9357694b-0ef8-4988-9fd0-f795855f9a99] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:28.239712 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-af1bd8b7-3c45-449a-a920-457884fceb7a tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:28.240173 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-af1bd8b7-3c45-449a-a920-457884fceb7a tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:28.245672 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-af1bd8b7-3c45-449a-a920-457884fceb7a tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:28.245672 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-af1bd8b7-3c45-449a-a920-457884fceb7a tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:28.245858 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-8cc6d211-65af-422f-af25-6128823d45b1 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:59:28.245858 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-8cc6d211-65af-422f-af25-6128823d45b1 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] [instance: 811eac08-9039-4d9e-a76f-fa4d6033f5a6] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:28.255133 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-8cc6d211-65af-422f-af25-6128823d45b1 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:28.255867 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-8cc6d211-65af-422f-af25-6128823d45b1 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:28.256804 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-8cc6d211-65af-422f-af25-6128823d45b1 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:28.257407 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-8cc6d211-65af-422f-af25-6128823d45b1 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:28.448950 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-af1bd8b7-3c45-449a-a920-457884fceb7a tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9e511074f445b09a3691e3328bee34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4d985046c34c1eb9e28915d7ebb5b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:59:28.450487 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-8cc6d211-65af-422f-af25-6128823d45b1 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be4bd5c0f2a400da491bae101b48832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515325707f64d58a28f26451b2c74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:59:28.457602 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-af1bd8b7-3c45-449a-a920-457884fceb7a tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] 10.222.0.81 "GET /compute/v2.1/servers/9357694b-0ef8-4988-9fd0-f795855f9a99" status: 200 len: 1315 microversion: 2.1 time: 0.229332 May 26 14:59:28.458194 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 144/310] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:59:28 2021] GET /compute/v2.1/servers/9357694b-0ef8-4988-9fd0-f795855f9a99 => generated 1315 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 14:59:28.465840 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-8cc6d211-65af-422f-af25-6128823d45b1 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /compute/v2.1/servers/811eac08-9039-4d9e-a76f-fa4d6033f5a6" status: 200 len: 1317 microversion: 2.1 time: 0.224342 May 26 14:59:28.466422 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 167/311] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:59:28 2021] GET /compute/v2.1/servers/811eac08-9039-4d9e-a76f-fa4d6033f5a6 => generated 1317 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 14:59:29.005372 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-9c8620aa-6b70-405c-9c65-a19a0fa62106 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:59:29.005943 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-9c8620aa-6b70-405c-9c65-a19a0fa62106 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 598b0e3f-8cf1-451a-80a8-ed7e5dd36984] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:29.013169 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-9c8620aa-6b70-405c-9c65-a19a0fa62106 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:29.013663 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-9c8620aa-6b70-405c-9c65-a19a0fa62106 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:29.014447 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-9c8620aa-6b70-405c-9c65-a19a0fa62106 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:29.014888 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-9c8620aa-6b70-405c-9c65-a19a0fa62106 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:29.074180 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.objects.instance [None req-9c8620aa-6b70-405c-9c65-a19a0fa62106 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lazy-loading 'flavor' on Instance uuid 598b0e3f-8cf1-451a-80a8-ed7e5dd36984 {{(pid=118514) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 26 14:59:29.082616 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-62e2a5d6-8a4f-4545-beb6-8fe36a9db10f tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:59:29.083183 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-62e2a5d6-8a4f-4545-beb6-8fe36a9db10f tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] [instance: aa145a33-41b1-4e39-9642-132aca11fcfe] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:29.093904 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-62e2a5d6-8a4f-4545-beb6-8fe36a9db10f tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:29.094687 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-62e2a5d6-8a4f-4545-beb6-8fe36a9db10f tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:29.096415 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-62e2a5d6-8a4f-4545-beb6-8fe36a9db10f tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:29.097027 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-62e2a5d6-8a4f-4545-beb6-8fe36a9db10f tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:29.363390 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-62e2a5d6-8a4f-4545-beb6-8fe36a9db10f tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b167942c895345b186a3eda5c82175b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad2ab2705ca479ab4aaafe7c80de162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:59:29.373356 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-62e2a5d6-8a4f-4545-beb6-8fe36a9db10f tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /compute/v2.1/servers/aa145a33-41b1-4e39-9642-132aca11fcfe" status: 200 len: 1521 microversion: 2.1 time: 0.295916 May 26 14:59:29.373953 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 168/312] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:59:29 2021] GET /compute/v2.1/servers/aa145a33-41b1-4e39-9642-132aca11fcfe => generated 1521 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 14:59:29.378764 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-a6fcca92-e5b4-40d0-b572-5d824803e788 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:59:29.379360 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-a6fcca92-e5b4-40d0-b572-5d824803e788 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] [instance: 990431e1-82cb-42b0-a288-949d79e21762] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:29.386459 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-a6fcca92-e5b4-40d0-b572-5d824803e788 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:29.386905 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-a6fcca92-e5b4-40d0-b572-5d824803e788 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:29.387671 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-a6fcca92-e5b4-40d0-b572-5d824803e788 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:29.388112 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-a6fcca92-e5b4-40d0-b572-5d824803e788 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:29.591229 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-a6fcca92-e5b4-40d0-b572-5d824803e788 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8604f942d44fec96828cc0b1ae5960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b729993a1944061bb0a708877c95a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:59:29.600084 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-a6fcca92-e5b4-40d0-b572-5d824803e788 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] 10.222.0.81 "GET /compute/v2.1/servers/990431e1-82cb-42b0-a288-949d79e21762" status: 200 len: 1319 microversion: 2.1 time: 0.225063 May 26 14:59:29.600677 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 169/313] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:59:29 2021] GET /compute/v2.1/servers/990431e1-82cb-42b0-a288-949d79e21762 => generated 1319 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:59:29.605837 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [req-410ca6c9-582f-42a7-824a-76bd79c2739c req-df4cf2e0-dd82-4bca-900b-c7ee66d1477e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "990431e1-82cb-42b0-a288-949d79e21762", "name": "network-vif-plugged", "status": "completed", "tag": "6140c9e0-a80c-4dc2-a884-ac0e5dbfdf15"}]} {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:59:29.607462 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 14:59:29.607462 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: warnings.warn(msg) May 26 14:59:29.616222 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [req-410ca6c9-582f-42a7-824a-76bd79c2739c req-df4cf2e0-dd82-4bca-900b-c7ee66d1477e service nova] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:29.616679 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [req-410ca6c9-582f-42a7-824a-76bd79c2739c req-df4cf2e0-dd82-4bca-900b-c7ee66d1477e service nova] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:29.633343 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.compute.server_external_events [req-410ca6c9-582f-42a7-824a-76bd79c2739c req-df4cf2e0-dd82-4bca-900b-c7ee66d1477e service nova] Creating event network-vif-plugged:6140c9e0-a80c-4dc2-a884-ac0e5dbfdf15 for instance 990431e1-82cb-42b0-a288-949d79e21762 on hv-cinder-78414 May 26 14:59:29.637842 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [req-410ca6c9-582f-42a7-824a-76bd79c2739c req-df4cf2e0-dd82-4bca-900b-c7ee66d1477e service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035866 May 26 14:59:29.638434 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 170/314] 10.222.0.81 () {64 vars in 1318 bytes} [Wed May 26 14:59:29 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:59:29.644321 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-c430260e-a8e4-4978-8f73-a816e301c9a0 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:59:29.645034 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-c430260e-a8e4-4978-8f73-a816e301c9a0 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] [instance: 9357694b-0ef8-4988-9fd0-f795855f9a99] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:29.652764 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-c430260e-a8e4-4978-8f73-a816e301c9a0 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:29.653248 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-c430260e-a8e4-4978-8f73-a816e301c9a0 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:29.654068 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-c430260e-a8e4-4978-8f73-a816e301c9a0 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:29.654658 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-c430260e-a8e4-4978-8f73-a816e301c9a0 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:29.866474 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-c430260e-a8e4-4978-8f73-a816e301c9a0 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9e511074f445b09a3691e3328bee34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4d985046c34c1eb9e28915d7ebb5b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:59:29.878420 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-c430260e-a8e4-4978-8f73-a816e301c9a0 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] 10.222.0.81 "GET /compute/v2.1/servers/9357694b-0ef8-4988-9fd0-f795855f9a99" status: 200 len: 1464 microversion: 2.1 time: 0.238760 May 26 14:59:29.887193 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 171/315] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:59:29 2021] GET /compute/v2.1/servers/9357694b-0ef8-4988-9fd0-f795855f9a99 => generated 1464 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:59:29.887193 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-ca33c75d-8162-4d90-b3be-51ae83a372ca tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:59:29.887193 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-ca33c75d-8162-4d90-b3be-51ae83a372ca tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] [instance: 811eac08-9039-4d9e-a76f-fa4d6033f5a6] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:29.895790 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-ca33c75d-8162-4d90-b3be-51ae83a372ca tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:29.895889 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-ca33c75d-8162-4d90-b3be-51ae83a372ca tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:29.896664 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-ca33c75d-8162-4d90-b3be-51ae83a372ca tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:29.897133 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-ca33c75d-8162-4d90-b3be-51ae83a372ca tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:29.980433 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-9c8620aa-6b70-405c-9c65-a19a0fa62106 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "POST /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984/action" status: 202 len: 0 microversion: 2.20 time: 0.978823 May 26 14:59:29.981482 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 145/316] 10.222.0.81 () {62 vars in 1319 bytes} [Wed May 26 14:59:29 2021] POST /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984/action => generated 0 bytes in 981 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 26 14:59:29.987313 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-b63e0816-7dd6-4f29-9c1a-8522d36906a2 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:59:29.990977 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-b63e0816-7dd6-4f29-9c1a-8522d36906a2 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] [instance: 9357694b-0ef8-4988-9fd0-f795855f9a99] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:29.995649 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-b63e0816-7dd6-4f29-9c1a-8522d36906a2 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:29.996102 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-b63e0816-7dd6-4f29-9c1a-8522d36906a2 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:29.996883 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-b63e0816-7dd6-4f29-9c1a-8522d36906a2 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:29.997323 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-b63e0816-7dd6-4f29-9c1a-8522d36906a2 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:30.059048 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-b63e0816-7dd6-4f29-9c1a-8522d36906a2 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] [instance: 9357694b-0ef8-4988-9fd0-f795855f9a99] Going to try to terminate instance {{(pid=118514) delete /opt/stack/nova/nova/compute/api.py:2539}} May 26 14:59:30.104902 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-ca33c75d-8162-4d90-b3be-51ae83a372ca tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be4bd5c0f2a400da491bae101b48832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515325707f64d58a28f26451b2c74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:59:30.113639 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-ca33c75d-8162-4d90-b3be-51ae83a372ca tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /compute/v2.1/servers/811eac08-9039-4d9e-a76f-fa4d6033f5a6" status: 200 len: 1317 microversion: 2.1 time: 0.233402 May 26 14:59:30.118836 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 172/317] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:59:29 2021] GET /compute/v2.1/servers/811eac08-9039-4d9e-a76f-fa4d6033f5a6 => generated 1317 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:59:30.118836 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-29085667-6b76-4b50-adfb-2007aab1c186 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:59:30.119034 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-29085667-6b76-4b50-adfb-2007aab1c186 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 598b0e3f-8cf1-451a-80a8-ed7e5dd36984] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:30.126665 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-29085667-6b76-4b50-adfb-2007aab1c186 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:30.127123 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-29085667-6b76-4b50-adfb-2007aab1c186 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:30.128047 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-29085667-6b76-4b50-adfb-2007aab1c186 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:30.128490 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-29085667-6b76-4b50-adfb-2007aab1c186 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:30.339060 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-29085667-6b76-4b50-adfb-2007aab1c186 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:59:30.348507 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-29085667-6b76-4b50-adfb-2007aab1c186 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:59:30.350106 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-29085667-6b76-4b50-adfb-2007aab1c186 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:59:30.351237 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-29085667-6b76-4b50-adfb-2007aab1c186 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984" status: 200 len: 1722 microversion: 2.20 time: 0.236101 May 26 14:59:30.351800 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 173/318] 10.222.0.81 () {60 vars in 1277 bytes} [Wed May 26 14:59:30 2021] GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984 => generated 1722 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:59:30.390645 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-974003cb-69e3-41d0-ae6f-1b3ab20f7d88 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:59:30.391333 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-974003cb-69e3-41d0-ae6f-1b3ab20f7d88 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] [instance: aa145a33-41b1-4e39-9642-132aca11fcfe] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:30.398643 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-974003cb-69e3-41d0-ae6f-1b3ab20f7d88 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:30.399096 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-974003cb-69e3-41d0-ae6f-1b3ab20f7d88 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:30.399943 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-974003cb-69e3-41d0-ae6f-1b3ab20f7d88 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:30.400384 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-974003cb-69e3-41d0-ae6f-1b3ab20f7d88 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:30.466492 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-b63e0816-7dd6-4f29-9c1a-8522d36906a2 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] 10.222.0.81 "DELETE /compute/v2.1/servers/9357694b-0ef8-4988-9fd0-f795855f9a99" status: 204 len: 0 microversion: 2.1 time: 0.483030 May 26 14:59:30.467078 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 146/319] 10.222.0.81 () {58 vars in 1239 bytes} [Wed May 26 14:59:29 2021] DELETE /compute/v2.1/servers/9357694b-0ef8-4988-9fd0-f795855f9a99 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 14:59:30.476238 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-21a70c1c-4d44-4ab5-9fe9-3e988b6f9d95 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:59:30.486265 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-21a70c1c-4d44-4ab5-9fe9-3e988b6f9d95 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] [instance: 9357694b-0ef8-4988-9fd0-f795855f9a99] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:30.486265 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-21a70c1c-4d44-4ab5-9fe9-3e988b6f9d95 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:30.486265 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-21a70c1c-4d44-4ab5-9fe9-3e988b6f9d95 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:30.486927 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-21a70c1c-4d44-4ab5-9fe9-3e988b6f9d95 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:30.487370 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-21a70c1c-4d44-4ab5-9fe9-3e988b6f9d95 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:30.604007 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-974003cb-69e3-41d0-ae6f-1b3ab20f7d88 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b167942c895345b186a3eda5c82175b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad2ab2705ca479ab4aaafe7c80de162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:59:30.612375 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-974003cb-69e3-41d0-ae6f-1b3ab20f7d88 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /compute/v2.1/servers/aa145a33-41b1-4e39-9642-132aca11fcfe" status: 200 len: 1521 microversion: 2.1 time: 0.225280 May 26 14:59:30.612958 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 174/320] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:59:30 2021] GET /compute/v2.1/servers/aa145a33-41b1-4e39-9642-132aca11fcfe => generated 1521 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 14:59:30.617326 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-37094a5b-4af3-44dc-9b51-51246657cc21 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:59:30.617993 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-37094a5b-4af3-44dc-9b51-51246657cc21 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] [instance: 990431e1-82cb-42b0-a288-949d79e21762] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:30.625207 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-37094a5b-4af3-44dc-9b51-51246657cc21 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:30.625706 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-37094a5b-4af3-44dc-9b51-51246657cc21 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:30.626531 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-37094a5b-4af3-44dc-9b51-51246657cc21 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:30.626976 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-37094a5b-4af3-44dc-9b51-51246657cc21 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:30.682313 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-21a70c1c-4d44-4ab5-9fe9-3e988b6f9d95 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9e511074f445b09a3691e3328bee34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4d985046c34c1eb9e28915d7ebb5b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:59:30.690760 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-21a70c1c-4d44-4ab5-9fe9-3e988b6f9d95 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] 10.222.0.81 "GET /compute/v2.1/servers/9357694b-0ef8-4988-9fd0-f795855f9a99" status: 200 len: 1470 microversion: 2.1 time: 0.218382 May 26 14:59:30.691434 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 147/321] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:59:30 2021] GET /compute/v2.1/servers/9357694b-0ef8-4988-9fd0-f795855f9a99 => generated 1470 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 14:59:30.819277 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-37094a5b-4af3-44dc-9b51-51246657cc21 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8604f942d44fec96828cc0b1ae5960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b729993a1944061bb0a708877c95a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:59:30.827401 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-37094a5b-4af3-44dc-9b51-51246657cc21 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] 10.222.0.81 "GET /compute/v2.1/servers/990431e1-82cb-42b0-a288-949d79e21762" status: 200 len: 1319 microversion: 2.1 time: 0.213481 May 26 14:59:30.827974 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 175/322] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:59:30 2021] GET /compute/v2.1/servers/990431e1-82cb-42b0-a288-949d79e21762 => generated 1319 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:59:31.131254 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-73cbb60e-b367-4563-90a7-a41f18bee372 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:59:31.131889 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-73cbb60e-b367-4563-90a7-a41f18bee372 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] [instance: 811eac08-9039-4d9e-a76f-fa4d6033f5a6] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:31.139270 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-73cbb60e-b367-4563-90a7-a41f18bee372 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:31.139713 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-73cbb60e-b367-4563-90a7-a41f18bee372 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:31.140473 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-73cbb60e-b367-4563-90a7-a41f18bee372 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:31.140903 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-73cbb60e-b367-4563-90a7-a41f18bee372 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:31.339249 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-73cbb60e-b367-4563-90a7-a41f18bee372 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be4bd5c0f2a400da491bae101b48832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515325707f64d58a28f26451b2c74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:59:31.347564 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-73cbb60e-b367-4563-90a7-a41f18bee372 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /compute/v2.1/servers/811eac08-9039-4d9e-a76f-fa4d6033f5a6" status: 200 len: 1317 microversion: 2.1 time: 0.220232 May 26 14:59:31.348110 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 148/323] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:59:31 2021] GET /compute/v2.1/servers/811eac08-9039-4d9e-a76f-fa4d6033f5a6 => generated 1317 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:59:31.370688 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-12dd01e5-75b3-4c71-a5dd-679dea88e7eb tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:59:31.371333 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-12dd01e5-75b3-4c71-a5dd-679dea88e7eb tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 598b0e3f-8cf1-451a-80a8-ed7e5dd36984] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:31.379214 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-12dd01e5-75b3-4c71-a5dd-679dea88e7eb tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:31.379676 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-12dd01e5-75b3-4c71-a5dd-679dea88e7eb tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:31.380461 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-12dd01e5-75b3-4c71-a5dd-679dea88e7eb tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:31.380904 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-12dd01e5-75b3-4c71-a5dd-679dea88e7eb tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:31.577248 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-12dd01e5-75b3-4c71-a5dd-679dea88e7eb tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:59:31.586044 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-12dd01e5-75b3-4c71-a5dd-679dea88e7eb tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:59:31.587593 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-12dd01e5-75b3-4c71-a5dd-679dea88e7eb tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:59:31.588725 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-12dd01e5-75b3-4c71-a5dd-679dea88e7eb tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984" status: 200 len: 1722 microversion: 2.20 time: 0.221709 May 26 14:59:31.589275 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 176/324] 10.222.0.81 () {60 vars in 1277 bytes} [Wed May 26 14:59:31 2021] GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984 => generated 1722 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:59:31.630323 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-540effe0-be0c-47f1-8a40-12bd67bb359e tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:59:31.630948 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-540effe0-be0c-47f1-8a40-12bd67bb359e tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] [instance: aa145a33-41b1-4e39-9642-132aca11fcfe] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:31.638603 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-540effe0-be0c-47f1-8a40-12bd67bb359e tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:31.639062 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-540effe0-be0c-47f1-8a40-12bd67bb359e tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:31.639842 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-540effe0-be0c-47f1-8a40-12bd67bb359e tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:31.640283 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-540effe0-be0c-47f1-8a40-12bd67bb359e tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:31.707439 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-7f23f213-2f8a-4887-8775-8c7fe975c601 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:59:31.708204 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-7f23f213-2f8a-4887-8775-8c7fe975c601 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] [instance: 9357694b-0ef8-4988-9fd0-f795855f9a99] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:31.715619 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-7f23f213-2f8a-4887-8775-8c7fe975c601 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:31.716064 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-7f23f213-2f8a-4887-8775-8c7fe975c601 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:31.716922 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-7f23f213-2f8a-4887-8775-8c7fe975c601 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:31.717302 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-7f23f213-2f8a-4887-8775-8c7fe975c601 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:31.841348 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-540effe0-be0c-47f1-8a40-12bd67bb359e tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b167942c895345b186a3eda5c82175b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad2ab2705ca479ab4aaafe7c80de162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:59:31.850134 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-540effe0-be0c-47f1-8a40-12bd67bb359e tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /compute/v2.1/servers/aa145a33-41b1-4e39-9642-132aca11fcfe" status: 200 len: 1521 microversion: 2.1 time: 0.224341 May 26 14:59:31.850706 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 149/325] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:59:31 2021] GET /compute/v2.1/servers/aa145a33-41b1-4e39-9642-132aca11fcfe => generated 1521 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:59:31.855027 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-257a095d-648d-4fae-9eab-f4f66346dbf7 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:59:31.855634 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-257a095d-648d-4fae-9eab-f4f66346dbf7 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] [instance: 990431e1-82cb-42b0-a288-949d79e21762] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:31.863444 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-257a095d-648d-4fae-9eab-f4f66346dbf7 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:31.863925 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-257a095d-648d-4fae-9eab-f4f66346dbf7 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:31.864697 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-257a095d-648d-4fae-9eab-f4f66346dbf7 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:31.865136 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-257a095d-648d-4fae-9eab-f4f66346dbf7 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:31.926556 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-7f23f213-2f8a-4887-8775-8c7fe975c601 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9e511074f445b09a3691e3328bee34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4d985046c34c1eb9e28915d7ebb5b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:59:31.935153 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-7f23f213-2f8a-4887-8775-8c7fe975c601 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] 10.222.0.81 "GET /compute/v2.1/servers/9357694b-0ef8-4988-9fd0-f795855f9a99" status: 200 len: 1470 microversion: 2.1 time: 0.231266 May 26 14:59:31.935727 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 177/326] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:59:31 2021] GET /compute/v2.1/servers/9357694b-0ef8-4988-9fd0-f795855f9a99 => generated 1470 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 14:59:32.059058 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-257a095d-648d-4fae-9eab-f4f66346dbf7 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8604f942d44fec96828cc0b1ae5960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b729993a1944061bb0a708877c95a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:59:32.067414 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-257a095d-648d-4fae-9eab-f4f66346dbf7 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] 10.222.0.81 "GET /compute/v2.1/servers/990431e1-82cb-42b0-a288-949d79e21762" status: 200 len: 1319 microversion: 2.1 time: 0.215698 May 26 14:59:32.067983 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 150/327] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:59:31 2021] GET /compute/v2.1/servers/990431e1-82cb-42b0-a288-949d79e21762 => generated 1319 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:59:32.364229 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-7f36cd2a-9620-4f72-8396-3a59605197fd tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:59:32.364765 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-7f36cd2a-9620-4f72-8396-3a59605197fd tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] [instance: 811eac08-9039-4d9e-a76f-fa4d6033f5a6] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:32.372098 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-7f36cd2a-9620-4f72-8396-3a59605197fd tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:32.372553 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-7f36cd2a-9620-4f72-8396-3a59605197fd tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:32.373327 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-7f36cd2a-9620-4f72-8396-3a59605197fd tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:32.373788 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-7f36cd2a-9620-4f72-8396-3a59605197fd tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:32.568065 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-7f36cd2a-9620-4f72-8396-3a59605197fd tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be4bd5c0f2a400da491bae101b48832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515325707f64d58a28f26451b2c74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:59:32.576183 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-7f36cd2a-9620-4f72-8396-3a59605197fd tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /compute/v2.1/servers/811eac08-9039-4d9e-a76f-fa4d6033f5a6" status: 200 len: 1317 microversion: 2.1 time: 0.215826 May 26 14:59:32.576737 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 178/328] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:59:32 2021] GET /compute/v2.1/servers/811eac08-9039-4d9e-a76f-fa4d6033f5a6 => generated 1317 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:59:32.607002 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-a04d85a8-cc51-4af3-8342-f7fcf1d9bae7 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:59:32.607614 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-a04d85a8-cc51-4af3-8342-f7fcf1d9bae7 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 598b0e3f-8cf1-451a-80a8-ed7e5dd36984] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:32.615274 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-a04d85a8-cc51-4af3-8342-f7fcf1d9bae7 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:32.615665 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-a04d85a8-cc51-4af3-8342-f7fcf1d9bae7 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:32.616442 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-a04d85a8-cc51-4af3-8342-f7fcf1d9bae7 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:32.616890 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-a04d85a8-cc51-4af3-8342-f7fcf1d9bae7 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:32.818737 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-a04d85a8-cc51-4af3-8342-f7fcf1d9bae7 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:59:32.829925 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-a04d85a8-cc51-4af3-8342-f7fcf1d9bae7 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:59:32.836747 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-a04d85a8-cc51-4af3-8342-f7fcf1d9bae7 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:59:32.836747 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-a04d85a8-cc51-4af3-8342-f7fcf1d9bae7 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984" status: 200 len: 1722 microversion: 2.20 time: 0.231124 May 26 14:59:32.846443 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 151/329] 10.222.0.81 () {60 vars in 1277 bytes} [Wed May 26 14:59:32 2021] GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984 => generated 1722 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:59:32.867623 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-06369781-2a48-4a7d-b50b-306cb589f642 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:59:32.868249 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-06369781-2a48-4a7d-b50b-306cb589f642 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] [instance: aa145a33-41b1-4e39-9642-132aca11fcfe] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:32.875963 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-06369781-2a48-4a7d-b50b-306cb589f642 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:32.882695 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-06369781-2a48-4a7d-b50b-306cb589f642 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:32.882695 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-06369781-2a48-4a7d-b50b-306cb589f642 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:32.882695 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-06369781-2a48-4a7d-b50b-306cb589f642 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:32.955742 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-6d86b316-3486-4ad7-8c96-7c15e75b7b40 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:59:32.956523 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-6d86b316-3486-4ad7-8c96-7c15e75b7b40 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] [instance: 9357694b-0ef8-4988-9fd0-f795855f9a99] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:32.987369 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-6d86b316-3486-4ad7-8c96-7c15e75b7b40 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:32.987831 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-6d86b316-3486-4ad7-8c96-7c15e75b7b40 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:32.988635 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-6d86b316-3486-4ad7-8c96-7c15e75b7b40 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:32.989095 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-6d86b316-3486-4ad7-8c96-7c15e75b7b40 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:33.139846 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-06369781-2a48-4a7d-b50b-306cb589f642 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b167942c895345b186a3eda5c82175b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad2ab2705ca479ab4aaafe7c80de162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:59:33.152463 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-06369781-2a48-4a7d-b50b-306cb589f642 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /compute/v2.1/servers/aa145a33-41b1-4e39-9642-132aca11fcfe" status: 200 len: 1521 microversion: 2.1 time: 0.288502 May 26 14:59:33.153427 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 179/330] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:59:32 2021] GET /compute/v2.1/servers/aa145a33-41b1-4e39-9642-132aca11fcfe => generated 1521 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:59:33.159575 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-9b5c528c-1acf-401c-aee8-2d3f8b934c2b tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:59:33.160792 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-9b5c528c-1acf-401c-aee8-2d3f8b934c2b tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] [instance: 990431e1-82cb-42b0-a288-949d79e21762] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:33.171309 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-9b5c528c-1acf-401c-aee8-2d3f8b934c2b tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:33.174209 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-9b5c528c-1acf-401c-aee8-2d3f8b934c2b tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:33.174209 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-9b5c528c-1acf-401c-aee8-2d3f8b934c2b tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:33.174209 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-9b5c528c-1acf-401c-aee8-2d3f8b934c2b tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:33.319310 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-6d86b316-3486-4ad7-8c96-7c15e75b7b40 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9e511074f445b09a3691e3328bee34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4d985046c34c1eb9e28915d7ebb5b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:59:33.322819 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-6d86b316-3486-4ad7-8c96-7c15e75b7b40 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] 10.222.0.81 "GET /compute/v2.1/servers/9357694b-0ef8-4988-9fd0-f795855f9a99" status: 200 len: 1470 microversion: 2.1 time: 0.374353 May 26 14:59:33.332589 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 152/331] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:59:32 2021] GET /compute/v2.1/servers/9357694b-0ef8-4988-9fd0-f795855f9a99 => generated 1470 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:59:33.430509 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-9b5c528c-1acf-401c-aee8-2d3f8b934c2b tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8604f942d44fec96828cc0b1ae5960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b729993a1944061bb0a708877c95a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:59:33.440214 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-9b5c528c-1acf-401c-aee8-2d3f8b934c2b tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] 10.222.0.81 "GET /compute/v2.1/servers/990431e1-82cb-42b0-a288-949d79e21762" status: 200 len: 1319 microversion: 2.1 time: 0.285675 May 26 14:59:33.440807 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 180/332] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:59:33 2021] GET /compute/v2.1/servers/990431e1-82cb-42b0-a288-949d79e21762 => generated 1319 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:59:33.595300 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-4cca29f5-cf5e-4bd6-92c1-ac74731d3ce3 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:59:33.596204 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-4cca29f5-cf5e-4bd6-92c1-ac74731d3ce3 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] [instance: 811eac08-9039-4d9e-a76f-fa4d6033f5a6] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:33.606958 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-4cca29f5-cf5e-4bd6-92c1-ac74731d3ce3 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:33.607411 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-4cca29f5-cf5e-4bd6-92c1-ac74731d3ce3 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:33.608200 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-4cca29f5-cf5e-4bd6-92c1-ac74731d3ce3 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:33.608647 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-4cca29f5-cf5e-4bd6-92c1-ac74731d3ce3 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:33.819404 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-4cca29f5-cf5e-4bd6-92c1-ac74731d3ce3 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be4bd5c0f2a400da491bae101b48832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515325707f64d58a28f26451b2c74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:59:33.827626 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-4cca29f5-cf5e-4bd6-92c1-ac74731d3ce3 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /compute/v2.1/servers/811eac08-9039-4d9e-a76f-fa4d6033f5a6" status: 200 len: 1317 microversion: 2.1 time: 0.237149 May 26 14:59:33.828200 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 153/333] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:59:33 2021] GET /compute/v2.1/servers/811eac08-9039-4d9e-a76f-fa4d6033f5a6 => generated 1317 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:59:33.853347 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-0f828ec5-b01d-40cc-8737-23c0a98ee0e1 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:59:33.854058 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-0f828ec5-b01d-40cc-8737-23c0a98ee0e1 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 598b0e3f-8cf1-451a-80a8-ed7e5dd36984] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:33.862483 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-0f828ec5-b01d-40cc-8737-23c0a98ee0e1 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:33.866441 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-0f828ec5-b01d-40cc-8737-23c0a98ee0e1 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:33.866441 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-0f828ec5-b01d-40cc-8737-23c0a98ee0e1 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:33.866441 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-0f828ec5-b01d-40cc-8737-23c0a98ee0e1 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:34.170614 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-0f91435a-5b5d-42b3-80f1-10cdeef77854 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:59:34.171239 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-0f91435a-5b5d-42b3-80f1-10cdeef77854 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] [instance: aa145a33-41b1-4e39-9642-132aca11fcfe] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:34.179576 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-0f91435a-5b5d-42b3-80f1-10cdeef77854 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:34.180040 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-0f91435a-5b5d-42b3-80f1-10cdeef77854 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:34.180840 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-0f91435a-5b5d-42b3-80f1-10cdeef77854 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:34.181285 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-0f91435a-5b5d-42b3-80f1-10cdeef77854 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:34.225845 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-0f828ec5-b01d-40cc-8737-23c0a98ee0e1 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:59:34.249620 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-0f828ec5-b01d-40cc-8737-23c0a98ee0e1 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:59:34.253089 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-0f828ec5-b01d-40cc-8737-23c0a98ee0e1 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:59:34.255381 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-0f828ec5-b01d-40cc-8737-23c0a98ee0e1 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984" status: 200 len: 1722 microversion: 2.20 time: 0.405468 May 26 14:59:34.256856 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 181/334] 10.222.0.81 () {60 vars in 1277 bytes} [Wed May 26 14:59:33 2021] GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984 => generated 1722 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:59:34.341239 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-3fa8d9fd-2518-4b4b-a10f-7175fca469be tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:59:34.341967 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-3fa8d9fd-2518-4b4b-a10f-7175fca469be tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] [instance: 9357694b-0ef8-4988-9fd0-f795855f9a99] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:34.352609 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-3fa8d9fd-2518-4b4b-a10f-7175fca469be tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:34.353149 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-3fa8d9fd-2518-4b4b-a10f-7175fca469be tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:34.354043 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-3fa8d9fd-2518-4b4b-a10f-7175fca469be tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:34.354658 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-3fa8d9fd-2518-4b4b-a10f-7175fca469be tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:34.450937 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-0f91435a-5b5d-42b3-80f1-10cdeef77854 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b167942c895345b186a3eda5c82175b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad2ab2705ca479ab4aaafe7c80de162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:59:34.461360 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-0f91435a-5b5d-42b3-80f1-10cdeef77854 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /compute/v2.1/servers/aa145a33-41b1-4e39-9642-132aca11fcfe" status: 200 len: 1521 microversion: 2.1 time: 0.294551 May 26 14:59:34.462249 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 154/335] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:59:34 2021] GET /compute/v2.1/servers/aa145a33-41b1-4e39-9642-132aca11fcfe => generated 1521 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 14:59:34.466780 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-45ceaa6f-996a-462a-84b3-226f07bcee71 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:59:34.467461 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-45ceaa6f-996a-462a-84b3-226f07bcee71 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] [instance: 990431e1-82cb-42b0-a288-949d79e21762] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:34.475853 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-45ceaa6f-996a-462a-84b3-226f07bcee71 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:34.476580 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-45ceaa6f-996a-462a-84b3-226f07bcee71 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:34.477434 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-45ceaa6f-996a-462a-84b3-226f07bcee71 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:34.478013 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-45ceaa6f-996a-462a-84b3-226f07bcee71 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:34.623923 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-3fa8d9fd-2518-4b4b-a10f-7175fca469be tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9e511074f445b09a3691e3328bee34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4d985046c34c1eb9e28915d7ebb5b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:59:34.623923 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-3fa8d9fd-2518-4b4b-a10f-7175fca469be tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] 10.222.0.81 "GET /compute/v2.1/servers/9357694b-0ef8-4988-9fd0-f795855f9a99" status: 200 len: 1470 microversion: 2.1 time: 0.272940 May 26 14:59:34.623923 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 182/336] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:59:34 2021] GET /compute/v2.1/servers/9357694b-0ef8-4988-9fd0-f795855f9a99 => generated 1470 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:59:34.698871 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-45ceaa6f-996a-462a-84b3-226f07bcee71 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8604f942d44fec96828cc0b1ae5960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b729993a1944061bb0a708877c95a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:59:34.707776 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-45ceaa6f-996a-462a-84b3-226f07bcee71 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] 10.222.0.81 "GET /compute/v2.1/servers/990431e1-82cb-42b0-a288-949d79e21762" status: 200 len: 1319 microversion: 2.1 time: 0.244311 May 26 14:59:34.708353 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 155/337] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:59:34 2021] GET /compute/v2.1/servers/990431e1-82cb-42b0-a288-949d79e21762 => generated 1319 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:59:34.845420 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-1992c7cb-3c47-489a-aea6-aefd0a669e55 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:59:34.846169 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-1992c7cb-3c47-489a-aea6-aefd0a669e55 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] [instance: 811eac08-9039-4d9e-a76f-fa4d6033f5a6] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:34.853981 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-1992c7cb-3c47-489a-aea6-aefd0a669e55 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:34.854306 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-1992c7cb-3c47-489a-aea6-aefd0a669e55 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:34.855217 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-1992c7cb-3c47-489a-aea6-aefd0a669e55 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:34.855781 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-1992c7cb-3c47-489a-aea6-aefd0a669e55 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:35.144139 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-1992c7cb-3c47-489a-aea6-aefd0a669e55 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be4bd5c0f2a400da491bae101b48832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515325707f64d58a28f26451b2c74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:59:35.152697 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-1992c7cb-3c47-489a-aea6-aefd0a669e55 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /compute/v2.1/servers/811eac08-9039-4d9e-a76f-fa4d6033f5a6" status: 200 len: 1317 microversion: 2.1 time: 0.311166 May 26 14:59:35.153257 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 183/338] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:59:34 2021] GET /compute/v2.1/servers/811eac08-9039-4d9e-a76f-fa4d6033f5a6 => generated 1317 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:59:35.274703 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-cdcc6c86-0ab7-44dd-8afa-d86fb33f234a tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:59:35.275223 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-cdcc6c86-0ab7-44dd-8afa-d86fb33f234a tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 598b0e3f-8cf1-451a-80a8-ed7e5dd36984] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:35.282754 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-cdcc6c86-0ab7-44dd-8afa-d86fb33f234a tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:35.283198 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-cdcc6c86-0ab7-44dd-8afa-d86fb33f234a tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:35.283971 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-cdcc6c86-0ab7-44dd-8afa-d86fb33f234a tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:35.284487 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-cdcc6c86-0ab7-44dd-8afa-d86fb33f234a tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:35.478906 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-866b03ab-f292-4911-b22a-779826bcf586 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:59:35.479728 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-866b03ab-f292-4911-b22a-779826bcf586 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] [instance: aa145a33-41b1-4e39-9642-132aca11fcfe] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:35.487230 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-cdcc6c86-0ab7-44dd-8afa-d86fb33f234a tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:59:35.487824 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-866b03ab-f292-4911-b22a-779826bcf586 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:35.488285 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-866b03ab-f292-4911-b22a-779826bcf586 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:35.489046 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-866b03ab-f292-4911-b22a-779826bcf586 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:35.489484 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-866b03ab-f292-4911-b22a-779826bcf586 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:35.497563 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-cdcc6c86-0ab7-44dd-8afa-d86fb33f234a tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:59:35.499452 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-cdcc6c86-0ab7-44dd-8afa-d86fb33f234a tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:59:35.500669 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-cdcc6c86-0ab7-44dd-8afa-d86fb33f234a tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984" status: 200 len: 1722 microversion: 2.20 time: 0.229841 May 26 14:59:35.501443 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 156/339] 10.222.0.81 () {60 vars in 1277 bytes} [Wed May 26 14:59:35 2021] GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984 => generated 1722 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:59:35.506304 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-dd5361bb-d1c7-4de0-973d-1f11685d0293 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:59:35.514295 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-dd5361bb-d1c7-4de0-973d-1f11685d0293 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:35.514825 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-dd5361bb-d1c7-4de0-973d-1f11685d0293 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:35.575603 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-dd5361bb-d1c7-4de0-973d-1f11685d0293 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: a9d8f9a6-bd66-4caa-8662-4bb94655ae59] Going to try to stop instance {{(pid=118514) force_stop /opt/stack/nova/nova/compute/api.py:2579}} May 26 14:59:35.689314 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-866b03ab-f292-4911-b22a-779826bcf586 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b167942c895345b186a3eda5c82175b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad2ab2705ca479ab4aaafe7c80de162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:59:35.697721 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-866b03ab-f292-4911-b22a-779826bcf586 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /compute/v2.1/servers/aa145a33-41b1-4e39-9642-132aca11fcfe" status: 200 len: 1501 microversion: 2.1 time: 0.222373 May 26 14:59:35.698295 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 184/340] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:59:35 2021] GET /compute/v2.1/servers/aa145a33-41b1-4e39-9642-132aca11fcfe => generated 1501 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 14:59:35.702533 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-d60fff73-01e1-41eb-88c3-b79d6aeb3117 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:59:35.703148 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-d60fff73-01e1-41eb-88c3-b79d6aeb3117 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] [instance: 9357694b-0ef8-4988-9fd0-f795855f9a99] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:35.710409 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-d60fff73-01e1-41eb-88c3-b79d6aeb3117 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:35.712158 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-d60fff73-01e1-41eb-88c3-b79d6aeb3117 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:35.712158 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-d60fff73-01e1-41eb-88c3-b79d6aeb3117 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:35.712158 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-d60fff73-01e1-41eb-88c3-b79d6aeb3117 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:35.789526 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-dd5361bb-d1c7-4de0-973d-1f11685d0293 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "POST /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59/action" status: 202 len: 0 microversion: 2.1 time: 0.286683 May 26 14:59:35.790187 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 157/341] 10.222.0.81 () {60 vars in 1278 bytes} [Wed May 26 14:59:35 2021] POST /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59/action => generated 0 bytes in 288 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 14:59:35.795474 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-66d1433f-36a8-460d-a60e-0684c958595d tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "49fe7c9c-2591-47e8-b793-b805e1d65d37"}} {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:59:35.796615 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-66d1433f-36a8-460d-a60e-0684c958595d tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] [instance: aa145a33-41b1-4e39-9642-132aca11fcfe] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:35.804651 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-66d1433f-36a8-460d-a60e-0684c958595d tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:35.805111 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-66d1433f-36a8-460d-a60e-0684c958595d tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:35.805931 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-66d1433f-36a8-460d-a60e-0684c958595d tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:35.806379 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-66d1433f-36a8-460d-a60e-0684c958595d tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:35.864254 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.wsgi [None req-66d1433f-36a8-460d-a60e-0684c958595d tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] HTTP exception thrown: Cannot 'attach_volume' instance aa145a33-41b1-4e39-9642-132aca11fcfe while it is in vm_state rescued May 26 14:59:35.864864 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-66d1433f-36a8-460d-a60e-0684c958595d tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Returning 409 to user: Cannot 'attach_volume' instance aa145a33-41b1-4e39-9642-132aca11fcfe while it is in vm_state rescued {{(pid=118514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 26 14:59:35.865734 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-66d1433f-36a8-460d-a60e-0684c958595d tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "POST /compute/v2.1/servers/aa145a33-41b1-4e39-9642-132aca11fcfe/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.074325 May 26 14:59:35.866293 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 158/342] 10.222.0.81 () {60 vars in 1323 bytes} [Wed May 26 14:59:35 2021] POST /compute/v2.1/servers/aa145a33-41b1-4e39-9642-132aca11fcfe/os-volume_attachments => generated 152 bytes in 76 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 26 14:59:35.870505 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-f6363971-b8e3-46a4-aacb-82b1584f202f tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:59:35.871114 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-f6363971-b8e3-46a4-aacb-82b1584f202f tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] [instance: 990431e1-82cb-42b0-a288-949d79e21762] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:35.878584 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-f6363971-b8e3-46a4-aacb-82b1584f202f tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:35.879044 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-f6363971-b8e3-46a4-aacb-82b1584f202f tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:35.879824 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-f6363971-b8e3-46a4-aacb-82b1584f202f tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:35.880264 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-f6363971-b8e3-46a4-aacb-82b1584f202f tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:35.918548 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-d60fff73-01e1-41eb-88c3-b79d6aeb3117 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9e511074f445b09a3691e3328bee34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4d985046c34c1eb9e28915d7ebb5b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:59:35.928363 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-d60fff73-01e1-41eb-88c3-b79d6aeb3117 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] 10.222.0.81 "GET /compute/v2.1/servers/9357694b-0ef8-4988-9fd0-f795855f9a99" status: 200 len: 1470 microversion: 2.1 time: 0.229002 May 26 14:59:35.929096 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 185/343] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:59:35 2021] GET /compute/v2.1/servers/9357694b-0ef8-4988-9fd0-f795855f9a99 => generated 1470 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:59:35.937524 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-8dc31905-c77c-4e55-85f5-1b0c7f23d31c tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:59:35.941596 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-8dc31905-c77c-4e55-85f5-1b0c7f23d31c tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: a9d8f9a6-bd66-4caa-8662-4bb94655ae59] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:35.950611 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-8dc31905-c77c-4e55-85f5-1b0c7f23d31c tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:35.951211 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-8dc31905-c77c-4e55-85f5-1b0c7f23d31c tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:35.952119 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-8dc31905-c77c-4e55-85f5-1b0c7f23d31c tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:35.952677 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-8dc31905-c77c-4e55-85f5-1b0c7f23d31c tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:36.153075 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-8dc31905-c77c-4e55-85f5-1b0c7f23d31c tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c2fb208b56d4d52b59ac09873f16180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e8cac36a174b2eb5a6e53fdf25b4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:59:36.162888 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-8dc31905-c77c-4e55-85f5-1b0c7f23d31c tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59" status: 200 len: 1723 microversion: 2.1 time: 0.232341 May 26 14:59:36.163678 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 186/344] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:59:35 2021] GET /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59 => generated 1723 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:59:36.172247 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-068c6e09-842d-4bd0-97fd-c7ce53bc2c89 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:59:36.172986 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-068c6e09-842d-4bd0-97fd-c7ce53bc2c89 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] [instance: aa145a33-41b1-4e39-9642-132aca11fcfe] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:36.181143 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-068c6e09-842d-4bd0-97fd-c7ce53bc2c89 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:36.181627 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-068c6e09-842d-4bd0-97fd-c7ce53bc2c89 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:36.182428 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-068c6e09-842d-4bd0-97fd-c7ce53bc2c89 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:36.182911 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-068c6e09-842d-4bd0-97fd-c7ce53bc2c89 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:36.291786 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-f6363971-b8e3-46a4-aacb-82b1584f202f tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8604f942d44fec96828cc0b1ae5960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b729993a1944061bb0a708877c95a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:59:36.300787 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-f6363971-b8e3-46a4-aacb-82b1584f202f tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] 10.222.0.81 "GET /compute/v2.1/servers/990431e1-82cb-42b0-a288-949d79e21762" status: 200 len: 1509 microversion: 2.1 time: 0.433473 May 26 14:59:36.301364 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 159/345] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:59:35 2021] GET /compute/v2.1/servers/990431e1-82cb-42b0-a288-949d79e21762 => generated 1509 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:59:36.305662 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-ad27f96c-5a8b-4725-8221-88732941ec45 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:59:36.306266 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-ad27f96c-5a8b-4725-8221-88732941ec45 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] [instance: 811eac08-9039-4d9e-a76f-fa4d6033f5a6] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:36.313346 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-ad27f96c-5a8b-4725-8221-88732941ec45 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:36.313834 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-ad27f96c-5a8b-4725-8221-88732941ec45 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:36.315300 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-ad27f96c-5a8b-4725-8221-88732941ec45 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:36.316231 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-ad27f96c-5a8b-4725-8221-88732941ec45 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:36.419564 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-068c6e09-842d-4bd0-97fd-c7ce53bc2c89 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "POST /compute/v2.1/servers/aa145a33-41b1-4e39-9642-132aca11fcfe/action" status: 202 len: 0 microversion: 2.1 time: 0.250968 May 26 14:59:36.423654 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 187/346] 10.222.0.81 () {60 vars in 1278 bytes} [Wed May 26 14:59:36 2021] POST /compute/v2.1/servers/aa145a33-41b1-4e39-9642-132aca11fcfe/action => generated 0 bytes in 256 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 14:59:36.429793 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-96628f7b-3725-4d98-b0f3-9c0f919a5c52 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:59:36.430486 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-96628f7b-3725-4d98-b0f3-9c0f919a5c52 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] [instance: aa145a33-41b1-4e39-9642-132aca11fcfe] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:36.438463 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-96628f7b-3725-4d98-b0f3-9c0f919a5c52 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:36.439065 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-96628f7b-3725-4d98-b0f3-9c0f919a5c52 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:36.458828 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-96628f7b-3725-4d98-b0f3-9c0f919a5c52 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:36.459293 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-96628f7b-3725-4d98-b0f3-9c0f919a5c52 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:36.788592 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-ad27f96c-5a8b-4725-8221-88732941ec45 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be4bd5c0f2a400da491bae101b48832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515325707f64d58a28f26451b2c74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:59:36.788592 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-ad27f96c-5a8b-4725-8221-88732941ec45 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /compute/v2.1/servers/811eac08-9039-4d9e-a76f-fa4d6033f5a6" status: 200 len: 1317 microversion: 2.1 time: 0.480246 May 26 14:59:36.788592 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 160/347] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:59:36 2021] GET /compute/v2.1/servers/811eac08-9039-4d9e-a76f-fa4d6033f5a6 => generated 1317 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:59:36.788592 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-998fa53d-526d-43fe-89d9-f75daea17e39 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:59:36.788983 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-998fa53d-526d-43fe-89d9-f75daea17e39 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 598b0e3f-8cf1-451a-80a8-ed7e5dd36984] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:36.795616 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-998fa53d-526d-43fe-89d9-f75daea17e39 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:36.796192 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-998fa53d-526d-43fe-89d9-f75daea17e39 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:36.797057 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-998fa53d-526d-43fe-89d9-f75daea17e39 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:36.797498 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-998fa53d-526d-43fe-89d9-f75daea17e39 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:36.834585 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-96628f7b-3725-4d98-b0f3-9c0f919a5c52 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b167942c895345b186a3eda5c82175b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad2ab2705ca479ab4aaafe7c80de162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:59:36.845348 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-96628f7b-3725-4d98-b0f3-9c0f919a5c52 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /compute/v2.1/servers/aa145a33-41b1-4e39-9642-132aca11fcfe" status: 200 len: 1509 microversion: 2.1 time: 0.419827 May 26 14:59:36.846502 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 188/348] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:59:36 2021] GET /compute/v2.1/servers/aa145a33-41b1-4e39-9642-132aca11fcfe => generated 1509 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:59:36.955441 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-4bfe093f-462d-47c8-9669-7a006441321f tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:59:36.956061 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-4bfe093f-462d-47c8-9669-7a006441321f tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] [instance: 9357694b-0ef8-4988-9fd0-f795855f9a99] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:36.963944 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-4bfe093f-462d-47c8-9669-7a006441321f tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:36.964553 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-4bfe093f-462d-47c8-9669-7a006441321f tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:36.965726 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-4bfe093f-462d-47c8-9669-7a006441321f tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:36.966039 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-4bfe093f-462d-47c8-9669-7a006441321f tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:37.044909 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-998fa53d-526d-43fe-89d9-f75daea17e39 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:59:37.056000 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-998fa53d-526d-43fe-89d9-f75daea17e39 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:59:37.057732 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-998fa53d-526d-43fe-89d9-f75daea17e39 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:59:37.058943 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-998fa53d-526d-43fe-89d9-f75daea17e39 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984" status: 200 len: 1722 microversion: 2.20 time: 0.274525 May 26 14:59:37.061584 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 161/349] 10.222.0.81 () {60 vars in 1277 bytes} [Wed May 26 14:59:36 2021] GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984 => generated 1722 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:59:37.182966 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-84d83abd-00f3-4e7a-a322-b027bbb8b1e8 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:59:37.182966 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-84d83abd-00f3-4e7a-a322-b027bbb8b1e8 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: a9d8f9a6-bd66-4caa-8662-4bb94655ae59] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:37.197461 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-84d83abd-00f3-4e7a-a322-b027bbb8b1e8 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:37.197977 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-84d83abd-00f3-4e7a-a322-b027bbb8b1e8 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:37.202001 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-84d83abd-00f3-4e7a-a322-b027bbb8b1e8 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:37.205342 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-84d83abd-00f3-4e7a-a322-b027bbb8b1e8 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:37.286406 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-4bfe093f-462d-47c8-9669-7a006441321f tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9e511074f445b09a3691e3328bee34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4d985046c34c1eb9e28915d7ebb5b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:59:37.298303 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-4bfe093f-462d-47c8-9669-7a006441321f tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] 10.222.0.81 "GET /compute/v2.1/servers/9357694b-0ef8-4988-9fd0-f795855f9a99" status: 200 len: 1470 microversion: 2.1 time: 0.347036 May 26 14:59:37.298918 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 189/350] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:59:36 2021] GET /compute/v2.1/servers/9357694b-0ef8-4988-9fd0-f795855f9a99 => generated 1470 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 14:59:37.321568 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [req-fd4bf35a-2f5b-4c4a-824d-6d724ab5a4e4 req-7b92378d-fdb8-4251-bc9f-e3f1a4637ec6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "811eac08-9039-4d9e-a76f-fa4d6033f5a6", "name": "network-vif-plugged", "status": "completed", "tag": "569fad69-3482-4ba8-829b-ffd9c0bc4482"}]} {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:59:37.327431 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 14:59:37.327431 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: warnings.warn(msg) May 26 14:59:37.337988 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [req-fd4bf35a-2f5b-4c4a-824d-6d724ab5a4e4 req-7b92378d-fdb8-4251-bc9f-e3f1a4637ec6 service nova] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:37.338363 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [req-fd4bf35a-2f5b-4c4a-824d-6d724ab5a4e4 req-7b92378d-fdb8-4251-bc9f-e3f1a4637ec6 service nova] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:37.362011 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.compute.server_external_events [req-fd4bf35a-2f5b-4c4a-824d-6d724ab5a4e4 req-7b92378d-fdb8-4251-bc9f-e3f1a4637ec6 service nova] Creating event network-vif-plugged:569fad69-3482-4ba8-829b-ffd9c0bc4482 for instance 811eac08-9039-4d9e-a76f-fa4d6033f5a6 on hv-cinder-78414 May 26 14:59:37.369069 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [req-fd4bf35a-2f5b-4c4a-824d-6d724ab5a4e4 req-7b92378d-fdb8-4251-bc9f-e3f1a4637ec6 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059348 May 26 14:59:37.369657 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 190/351] 10.222.0.81 () {64 vars in 1318 bytes} [Wed May 26 14:59:37 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:59:37.375268 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [req-8fc7ce1a-45c2-4c7a-8b8b-e75d54fca469 req-ae3cde7a-aef7-4a70-afce-d50007b8ab6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9357694b-0ef8-4988-9fd0-f795855f9a99", "name": "network-vif-deleted", "tag": "af4a6c11-6609-4623-bb2f-1fecb6f3099a"}]} {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:59:37.377074 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 14:59:37.377074 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: warnings.warn(msg) May 26 14:59:37.386333 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [req-8fc7ce1a-45c2-4c7a-8b8b-e75d54fca469 req-ae3cde7a-aef7-4a70-afce-d50007b8ab6f service nova] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:37.387056 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [req-8fc7ce1a-45c2-4c7a-8b8b-e75d54fca469 req-ae3cde7a-aef7-4a70-afce-d50007b8ab6f service nova] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:37.407292 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.compute.server_external_events [req-8fc7ce1a-45c2-4c7a-8b8b-e75d54fca469 req-ae3cde7a-aef7-4a70-afce-d50007b8ab6f service nova] Creating event network-vif-deleted:af4a6c11-6609-4623-bb2f-1fecb6f3099a for instance 9357694b-0ef8-4988-9fd0-f795855f9a99 on hv-cinder-78414 May 26 14:59:37.427280 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [req-8fc7ce1a-45c2-4c7a-8b8b-e75d54fca469 req-ae3cde7a-aef7-4a70-afce-d50007b8ab6f service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055404 May 26 14:59:37.428668 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 191/352] 10.222.0.81 () {64 vars in 1318 bytes} [Wed May 26 14:59:37 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:59:37.585787 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-84d83abd-00f3-4e7a-a322-b027bbb8b1e8 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c2fb208b56d4d52b59ac09873f16180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e8cac36a174b2eb5a6e53fdf25b4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:59:37.592774 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-84d83abd-00f3-4e7a-a322-b027bbb8b1e8 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59" status: 200 len: 1723 microversion: 2.1 time: 0.415100 May 26 14:59:37.593348 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 162/353] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:59:37 2021] GET /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59 => generated 1723 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 14:59:37.808308 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-3b18ca07-460c-4d98-b1bb-eeef063285ce tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:59:37.809800 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-3b18ca07-460c-4d98-b1bb-eeef063285ce tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] [instance: 811eac08-9039-4d9e-a76f-fa4d6033f5a6] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:37.818884 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-3b18ca07-460c-4d98-b1bb-eeef063285ce tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:37.819322 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-3b18ca07-460c-4d98-b1bb-eeef063285ce tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:37.824746 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-3b18ca07-460c-4d98-b1bb-eeef063285ce tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:37.824746 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-3b18ca07-460c-4d98-b1bb-eeef063285ce tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:37.864278 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-d2ab4a87-2403-4a32-8f25-84faea86430e tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:59:37.864958 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-d2ab4a87-2403-4a32-8f25-84faea86430e tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] [instance: aa145a33-41b1-4e39-9642-132aca11fcfe] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:37.872559 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-d2ab4a87-2403-4a32-8f25-84faea86430e tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:37.873687 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-d2ab4a87-2403-4a32-8f25-84faea86430e tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:37.874686 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-d2ab4a87-2403-4a32-8f25-84faea86430e tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:37.875127 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-d2ab4a87-2403-4a32-8f25-84faea86430e tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:38.057527 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-3b18ca07-460c-4d98-b1bb-eeef063285ce tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be4bd5c0f2a400da491bae101b48832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515325707f64d58a28f26451b2c74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:59:38.066874 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-3b18ca07-460c-4d98-b1bb-eeef063285ce tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /compute/v2.1/servers/811eac08-9039-4d9e-a76f-fa4d6033f5a6" status: 200 len: 1317 microversion: 2.1 time: 0.263836 May 26 14:59:38.067532 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 192/354] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:59:37 2021] GET /compute/v2.1/servers/811eac08-9039-4d9e-a76f-fa4d6033f5a6 => generated 1317 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:59:38.077245 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-71751a3d-0c60-4f79-93fd-d842ac056b0b tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:59:38.079743 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-71751a3d-0c60-4f79-93fd-d842ac056b0b tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 598b0e3f-8cf1-451a-80a8-ed7e5dd36984] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:38.085571 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-71751a3d-0c60-4f79-93fd-d842ac056b0b tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:38.086068 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-71751a3d-0c60-4f79-93fd-d842ac056b0b tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:38.086875 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-71751a3d-0c60-4f79-93fd-d842ac056b0b tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:38.087251 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-d2ab4a87-2403-4a32-8f25-84faea86430e tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b167942c895345b186a3eda5c82175b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad2ab2705ca479ab4aaafe7c80de162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:59:38.087376 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-71751a3d-0c60-4f79-93fd-d842ac056b0b tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:38.096278 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-d2ab4a87-2403-4a32-8f25-84faea86430e tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /compute/v2.1/servers/aa145a33-41b1-4e39-9642-132aca11fcfe" status: 200 len: 1509 microversion: 2.1 time: 0.235708 May 26 14:59:38.097462 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 163/355] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:59:37 2021] GET /compute/v2.1/servers/aa145a33-41b1-4e39-9642-132aca11fcfe => generated 1509 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 14:59:38.290034 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-71751a3d-0c60-4f79-93fd-d842ac056b0b tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:59:38.299460 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-71751a3d-0c60-4f79-93fd-d842ac056b0b tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:59:38.301094 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-71751a3d-0c60-4f79-93fd-d842ac056b0b tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:59:38.302263 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-71751a3d-0c60-4f79-93fd-d842ac056b0b tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984" status: 200 len: 1722 microversion: 2.20 time: 0.228870 May 26 14:59:38.302811 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 193/356] 10.222.0.81 () {60 vars in 1277 bytes} [Wed May 26 14:59:38 2021] GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984 => generated 1722 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 14:59:38.316509 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-cece2d7b-fdc2-4602-b490-37eedc9ce9a2 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:59:38.317198 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-cece2d7b-fdc2-4602-b490-37eedc9ce9a2 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] [instance: 9357694b-0ef8-4988-9fd0-f795855f9a99] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:38.325195 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-cece2d7b-fdc2-4602-b490-37eedc9ce9a2 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:38.325899 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-cece2d7b-fdc2-4602-b490-37eedc9ce9a2 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:38.326867 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-cece2d7b-fdc2-4602-b490-37eedc9ce9a2 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:38.327371 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-cece2d7b-fdc2-4602-b490-37eedc9ce9a2 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:38.401980 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-cece2d7b-fdc2-4602-b490-37eedc9ce9a2 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:38.402502 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-cece2d7b-fdc2-4602-b490-37eedc9ce9a2 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:38.402847 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.objects.instance [None req-cece2d7b-fdc2-4602-b490-37eedc9ce9a2 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Lazy-loading 'fault' on Instance uuid 9357694b-0ef8-4988-9fd0-f795855f9a99 {{(pid=118514) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 26 14:59:38.589195 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-cece2d7b-fdc2-4602-b490-37eedc9ce9a2 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9e511074f445b09a3691e3328bee34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a4d985046c34c1eb9e28915d7ebb5b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:59:38.598174 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-cece2d7b-fdc2-4602-b490-37eedc9ce9a2 tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] 10.222.0.81 "GET /compute/v2.1/servers/9357694b-0ef8-4988-9fd0-f795855f9a99" status: 200 len: 1305 microversion: 2.1 time: 0.286547 May 26 14:59:38.598763 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 164/357] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:59:38 2021] GET /compute/v2.1/servers/9357694b-0ef8-4988-9fd0-f795855f9a99 => generated 1305 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:59:38.610267 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-187c624e-7e27-420d-a8bd-57ae774a9b82 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:59:38.610888 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-187c624e-7e27-420d-a8bd-57ae774a9b82 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: a9d8f9a6-bd66-4caa-8662-4bb94655ae59] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:38.618990 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-187c624e-7e27-420d-a8bd-57ae774a9b82 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:38.619453 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-187c624e-7e27-420d-a8bd-57ae774a9b82 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:38.620232 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-187c624e-7e27-420d-a8bd-57ae774a9b82 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:38.620685 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-187c624e-7e27-420d-a8bd-57ae774a9b82 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:38.829871 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-187c624e-7e27-420d-a8bd-57ae774a9b82 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c2fb208b56d4d52b59ac09873f16180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e8cac36a174b2eb5a6e53fdf25b4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:59:38.839627 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-187c624e-7e27-420d-a8bd-57ae774a9b82 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59" status: 200 len: 1723 microversion: 2.1 time: 0.233031 May 26 14:59:38.840174 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 194/358] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:59:38 2021] GET /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59 => generated 1723 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:59:39.084697 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-0cb7cd9c-cda9-497d-8b13-bb3189e9596f tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:59:39.085327 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-0cb7cd9c-cda9-497d-8b13-bb3189e9596f tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] [instance: 811eac08-9039-4d9e-a76f-fa4d6033f5a6] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:39.093130 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-0cb7cd9c-cda9-497d-8b13-bb3189e9596f tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:39.093676 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-0cb7cd9c-cda9-497d-8b13-bb3189e9596f tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:39.094480 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-0cb7cd9c-cda9-497d-8b13-bb3189e9596f tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:39.094942 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-0cb7cd9c-cda9-497d-8b13-bb3189e9596f tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:39.114010 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-6b55c82d-3024-4852-9fdb-77ab5c69cea7 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:59:39.114626 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-6b55c82d-3024-4852-9fdb-77ab5c69cea7 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] [instance: aa145a33-41b1-4e39-9642-132aca11fcfe] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:39.121922 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-6b55c82d-3024-4852-9fdb-77ab5c69cea7 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:39.122362 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-6b55c82d-3024-4852-9fdb-77ab5c69cea7 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:39.123136 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-6b55c82d-3024-4852-9fdb-77ab5c69cea7 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:39.123761 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-6b55c82d-3024-4852-9fdb-77ab5c69cea7 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:39.299446 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-0cb7cd9c-cda9-497d-8b13-bb3189e9596f tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be4bd5c0f2a400da491bae101b48832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515325707f64d58a28f26451b2c74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:59:39.309052 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-0cb7cd9c-cda9-497d-8b13-bb3189e9596f tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /compute/v2.1/servers/811eac08-9039-4d9e-a76f-fa4d6033f5a6" status: 200 len: 1317 microversion: 2.1 time: 0.228878 May 26 14:59:39.320582 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 165/359] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:59:39 2021] GET /compute/v2.1/servers/811eac08-9039-4d9e-a76f-fa4d6033f5a6 => generated 1317 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:59:39.325941 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-5c5a3524-3738-4eb9-95c8-ac2066aed71d tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:59:39.326833 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-5c5a3524-3738-4eb9-95c8-ac2066aed71d tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 598b0e3f-8cf1-451a-80a8-ed7e5dd36984] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:39.333336 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-6b55c82d-3024-4852-9fdb-77ab5c69cea7 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b167942c895345b186a3eda5c82175b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad2ab2705ca479ab4aaafe7c80de162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:59:39.335699 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-5c5a3524-3738-4eb9-95c8-ac2066aed71d tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:39.336160 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-5c5a3524-3738-4eb9-95c8-ac2066aed71d tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:39.336956 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-5c5a3524-3738-4eb9-95c8-ac2066aed71d tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:39.337407 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-5c5a3524-3738-4eb9-95c8-ac2066aed71d tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:39.342636 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-6b55c82d-3024-4852-9fdb-77ab5c69cea7 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /compute/v2.1/servers/aa145a33-41b1-4e39-9642-132aca11fcfe" status: 200 len: 1509 microversion: 2.1 time: 0.232416 May 26 14:59:39.343163 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 195/360] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:59:39 2021] GET /compute/v2.1/servers/aa145a33-41b1-4e39-9642-132aca11fcfe => generated 1509 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 14:59:39.544094 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-5c5a3524-3738-4eb9-95c8-ac2066aed71d tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:59:39.554715 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-5c5a3524-3738-4eb9-95c8-ac2066aed71d tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:59:39.556430 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-5c5a3524-3738-4eb9-95c8-ac2066aed71d tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:59:39.557597 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-5c5a3524-3738-4eb9-95c8-ac2066aed71d tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984" status: 200 len: 1722 microversion: 2.20 time: 0.235451 May 26 14:59:39.558297 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 166/361] 10.222.0.81 () {60 vars in 1277 bytes} [Wed May 26 14:59:39 2021] GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984 => generated 1722 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:59:39.615272 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-bbee3b46-0363-46c2-9bfc-ba7220d20bea tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:59:39.615876 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-bbee3b46-0363-46c2-9bfc-ba7220d20bea tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] [instance: 9357694b-0ef8-4988-9fd0-f795855f9a99] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:39.623023 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-bbee3b46-0363-46c2-9bfc-ba7220d20bea tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:39.623472 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-bbee3b46-0363-46c2-9bfc-ba7220d20bea tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:39.624241 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-bbee3b46-0363-46c2-9bfc-ba7220d20bea tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:39.624677 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-bbee3b46-0363-46c2-9bfc-ba7220d20bea tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:39.676622 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.wsgi [None req-bbee3b46-0363-46c2-9bfc-ba7220d20bea tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] HTTP exception thrown: Instance 9357694b-0ef8-4988-9fd0-f795855f9a99 could not be found. May 26 14:59:39.677231 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-bbee3b46-0363-46c2-9bfc-ba7220d20bea tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] Returning 404 to user: Instance 9357694b-0ef8-4988-9fd0-f795855f9a99 could not be found. {{(pid=118513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 26 14:59:39.678097 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-bbee3b46-0363-46c2-9bfc-ba7220d20bea tempest-VolumesNegativeTest-841930140 tempest-VolumesNegativeTest-841930140-project] 10.222.0.81 "GET /compute/v2.1/servers/9357694b-0ef8-4988-9fd0-f795855f9a99" status: 404 len: 111 microversion: 2.1 time: 0.066903 May 26 14:59:39.678646 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 196/362] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:59:39 2021] GET /compute/v2.1/servers/9357694b-0ef8-4988-9fd0-f795855f9a99 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 14:59:39.859097 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-6cabf100-5bc1-4ed3-8ea9-858ce6348f54 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:59:39.859840 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-6cabf100-5bc1-4ed3-8ea9-858ce6348f54 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: a9d8f9a6-bd66-4caa-8662-4bb94655ae59] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:39.868306 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-6cabf100-5bc1-4ed3-8ea9-858ce6348f54 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:39.868879 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-6cabf100-5bc1-4ed3-8ea9-858ce6348f54 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:39.869802 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-6cabf100-5bc1-4ed3-8ea9-858ce6348f54 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:39.870361 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-6cabf100-5bc1-4ed3-8ea9-858ce6348f54 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:40.162630 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-6cabf100-5bc1-4ed3-8ea9-858ce6348f54 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c2fb208b56d4d52b59ac09873f16180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e8cac36a174b2eb5a6e53fdf25b4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:59:40.171893 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-6cabf100-5bc1-4ed3-8ea9-858ce6348f54 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59" status: 200 len: 1723 microversion: 2.1 time: 0.317075 May 26 14:59:40.172543 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 167/363] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:59:39 2021] GET /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59 => generated 1723 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:59:40.327124 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-f1138fe9-ea70-449a-87b2-427f86c6087e tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:59:40.327729 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-f1138fe9-ea70-449a-87b2-427f86c6087e tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] [instance: 811eac08-9039-4d9e-a76f-fa4d6033f5a6] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:40.335145 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-f1138fe9-ea70-449a-87b2-427f86c6087e tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:40.335599 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-f1138fe9-ea70-449a-87b2-427f86c6087e tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:40.336413 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-f1138fe9-ea70-449a-87b2-427f86c6087e tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:40.336854 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-f1138fe9-ea70-449a-87b2-427f86c6087e tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:40.358952 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-da2e0222-0d50-4f5a-bda0-d9e1446e361e tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:59:40.359572 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-da2e0222-0d50-4f5a-bda0-d9e1446e361e tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] [instance: aa145a33-41b1-4e39-9642-132aca11fcfe] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:40.367672 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-da2e0222-0d50-4f5a-bda0-d9e1446e361e tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:40.368132 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-da2e0222-0d50-4f5a-bda0-d9e1446e361e tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:40.368913 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-da2e0222-0d50-4f5a-bda0-d9e1446e361e tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:40.369357 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-da2e0222-0d50-4f5a-bda0-d9e1446e361e tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:40.596877 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-da2e0222-0d50-4f5a-bda0-d9e1446e361e tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b167942c895345b186a3eda5c82175b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad2ab2705ca479ab4aaafe7c80de162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:59:40.605074 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-da2e0222-0d50-4f5a-bda0-d9e1446e361e tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /compute/v2.1/servers/aa145a33-41b1-4e39-9642-132aca11fcfe" status: 200 len: 1509 microversion: 2.1 time: 0.249793 May 26 14:59:40.605659 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 168/364] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:59:40 2021] GET /compute/v2.1/servers/aa145a33-41b1-4e39-9642-132aca11fcfe => generated 1509 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 14:59:40.609947 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-9446249b-0249-4dcf-85af-58c2e67caa78 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:59:40.610548 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-9446249b-0249-4dcf-85af-58c2e67caa78 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 598b0e3f-8cf1-451a-80a8-ed7e5dd36984] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:40.618300 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-9446249b-0249-4dcf-85af-58c2e67caa78 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:40.618746 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-9446249b-0249-4dcf-85af-58c2e67caa78 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:40.623126 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-9446249b-0249-4dcf-85af-58c2e67caa78 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:40.623126 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-9446249b-0249-4dcf-85af-58c2e67caa78 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:40.634185 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-f1138fe9-ea70-449a-87b2-427f86c6087e tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be4bd5c0f2a400da491bae101b48832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515325707f64d58a28f26451b2c74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:59:40.647306 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-f1138fe9-ea70-449a-87b2-427f86c6087e tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /compute/v2.1/servers/811eac08-9039-4d9e-a76f-fa4d6033f5a6" status: 200 len: 1508 microversion: 2.1 time: 0.323708 May 26 14:59:40.649421 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 197/365] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:59:40 2021] GET /compute/v2.1/servers/811eac08-9039-4d9e-a76f-fa4d6033f5a6 => generated 1508 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:59:40.669885 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-b3e69216-da2e-40a2-b6eb-f733a6d4c923 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5977b52d-1937-437c-bdb0-2973e0fec095"}} {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:59:40.671242 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-b3e69216-da2e-40a2-b6eb-f733a6d4c923 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] [instance: 811eac08-9039-4d9e-a76f-fa4d6033f5a6] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:40.679272 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-b3e69216-da2e-40a2-b6eb-f733a6d4c923 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:40.680111 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-b3e69216-da2e-40a2-b6eb-f733a6d4c923 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:40.681090 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-b3e69216-da2e-40a2-b6eb-f733a6d4c923 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:40.681566 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-b3e69216-da2e-40a2-b6eb-f733a6d4c923 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:40.912466 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.wsgi [None req-b3e69216-da2e-40a2-b6eb-f733a6d4c923 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] HTTP exception thrown: Invalid volume: volume 5977b52d-1937-437c-bdb0-2973e0fec095 is already attached to instances: 396d0570-c547-4549-8fe6-dd156ef64c4b May 26 14:59:40.913098 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-b3e69216-da2e-40a2-b6eb-f733a6d4c923 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Returning 400 to user: Invalid volume: volume 5977b52d-1937-437c-bdb0-2973e0fec095 is already attached to instances: 396d0570-c547-4549-8fe6-dd156ef64c4b {{(pid=118513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 26 14:59:40.917769 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-b3e69216-da2e-40a2-b6eb-f733a6d4c923 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "POST /compute/v2.1/servers/811eac08-9039-4d9e-a76f-fa4d6033f5a6/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.252585 May 26 14:59:40.918346 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 198/366] 10.222.0.81 () {60 vars in 1323 bytes} [Wed May 26 14:59:40 2021] POST /compute/v2.1/servers/811eac08-9039-4d9e-a76f-fa4d6033f5a6/os-volume_attachments => generated 174 bytes in 254 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 26 14:59:41.005904 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-9446249b-0249-4dcf-85af-58c2e67caa78 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:59:41.022885 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-9446249b-0249-4dcf-85af-58c2e67caa78 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:59:41.022885 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-9446249b-0249-4dcf-85af-58c2e67caa78 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:59:41.022885 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-9446249b-0249-4dcf-85af-58c2e67caa78 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984" status: 200 len: 1722 microversion: 2.20 time: 0.414320 May 26 14:59:41.024417 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 169/367] 10.222.0.81 () {60 vars in 1277 bytes} [Wed May 26 14:59:40 2021] GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984 => generated 1722 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:59:41.089404 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-0d4b2aea-e82b-4038-8ad7-cf4b8c98616f tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:59:41.089978 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-0d4b2aea-e82b-4038-8ad7-cf4b8c98616f tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] [instance: 396d0570-c547-4549-8fe6-dd156ef64c4b] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:41.106769 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-0d4b2aea-e82b-4038-8ad7-cf4b8c98616f tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:41.107363 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-0d4b2aea-e82b-4038-8ad7-cf4b8c98616f tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:41.108244 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-0d4b2aea-e82b-4038-8ad7-cf4b8c98616f tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:41.108697 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-0d4b2aea-e82b-4038-8ad7-cf4b8c98616f tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:41.190488 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-7d184a2a-b246-4695-b2db-7545ee8878aa tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:59:41.191497 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-7d184a2a-b246-4695-b2db-7545ee8878aa tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: a9d8f9a6-bd66-4caa-8662-4bb94655ae59] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:41.199468 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-7d184a2a-b246-4695-b2db-7545ee8878aa tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:41.200009 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-7d184a2a-b246-4695-b2db-7545ee8878aa tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:41.200863 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-7d184a2a-b246-4695-b2db-7545ee8878aa tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:41.201372 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-7d184a2a-b246-4695-b2db-7545ee8878aa tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:41.303290 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.objects.instance [None req-0d4b2aea-e82b-4038-8ad7-cf4b8c98616f tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lazy-loading 'services' on Instance uuid 396d0570-c547-4549-8fe6-dd156ef64c4b {{(pid=118513) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 26 14:59:41.428161 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-7d184a2a-b246-4695-b2db-7545ee8878aa tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c2fb208b56d4d52b59ac09873f16180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e8cac36a174b2eb5a6e53fdf25b4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:59:41.438900 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-7d184a2a-b246-4695-b2db-7545ee8878aa tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59" status: 200 len: 1723 microversion: 2.1 time: 0.252773 May 26 14:59:41.439642 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 170/368] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:59:41 2021] GET /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59 => generated 1723 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 14:59:41.622302 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-c5072472-87dd-4074-90c1-65e18b45c3bb tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:59:41.622938 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-c5072472-87dd-4074-90c1-65e18b45c3bb tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] [instance: aa145a33-41b1-4e39-9642-132aca11fcfe] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:41.630141 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-c5072472-87dd-4074-90c1-65e18b45c3bb tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:41.630587 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-c5072472-87dd-4074-90c1-65e18b45c3bb tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:41.631356 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-c5072472-87dd-4074-90c1-65e18b45c3bb tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:41.631788 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-c5072472-87dd-4074-90c1-65e18b45c3bb tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:41.706021 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-0d4b2aea-e82b-4038-8ad7-cf4b8c98616f tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "DELETE /compute/v2.1/servers/396d0570-c547-4549-8fe6-dd156ef64c4b/os-volume_attachments/5977b52d-1937-437c-bdb0-2973e0fec095" status: 202 len: 0 microversion: 2.1 time: 0.628471 May 26 14:59:41.706891 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 199/369] 10.222.0.81 () {58 vars in 1416 bytes} [Wed May 26 14:59:41 2021] DELETE /compute/v2.1/servers/396d0570-c547-4549-8fe6-dd156ef64c4b/os-volume_attachments/5977b52d-1937-437c-bdb0-2973e0fec095 => generated 0 bytes in 631 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 14:59:41.938602 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-c5072472-87dd-4074-90c1-65e18b45c3bb tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b167942c895345b186a3eda5c82175b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad2ab2705ca479ab4aaafe7c80de162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:59:41.948744 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-c5072472-87dd-4074-90c1-65e18b45c3bb tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /compute/v2.1/servers/aa145a33-41b1-4e39-9642-132aca11fcfe" status: 200 len: 1515 microversion: 2.1 time: 0.330068 May 26 14:59:41.956865 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 171/370] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:59:41 2021] GET /compute/v2.1/servers/aa145a33-41b1-4e39-9642-132aca11fcfe => generated 1515 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 14:59:42.041362 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-bd8d8ebc-6ebf-4459-8668-64ed69f169c6 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:59:42.042554 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-bd8d8ebc-6ebf-4459-8668-64ed69f169c6 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 598b0e3f-8cf1-451a-80a8-ed7e5dd36984] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:42.054599 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-bd8d8ebc-6ebf-4459-8668-64ed69f169c6 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:42.055102 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-bd8d8ebc-6ebf-4459-8668-64ed69f169c6 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:42.058295 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-bd8d8ebc-6ebf-4459-8668-64ed69f169c6 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:42.058295 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-bd8d8ebc-6ebf-4459-8668-64ed69f169c6 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:42.361189 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-bd8d8ebc-6ebf-4459-8668-64ed69f169c6 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:59:42.370706 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-bd8d8ebc-6ebf-4459-8668-64ed69f169c6 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:59:42.372271 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-bd8d8ebc-6ebf-4459-8668-64ed69f169c6 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:59:42.373404 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-bd8d8ebc-6ebf-4459-8668-64ed69f169c6 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984" status: 200 len: 1722 microversion: 2.20 time: 0.336754 May 26 14:59:42.374007 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 200/371] 10.222.0.81 () {60 vars in 1277 bytes} [Wed May 26 14:59:42 2021] GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984 => generated 1722 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:59:42.456165 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-ea867441-bcd4-4458-8686-bb140261e247 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:59:42.457646 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-ea867441-bcd4-4458-8686-bb140261e247 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: a9d8f9a6-bd66-4caa-8662-4bb94655ae59] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:42.465946 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-ea867441-bcd4-4458-8686-bb140261e247 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:42.466479 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-ea867441-bcd4-4458-8686-bb140261e247 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:42.467496 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-ea867441-bcd4-4458-8686-bb140261e247 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:42.467996 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-ea867441-bcd4-4458-8686-bb140261e247 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:42.781623 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-ea867441-bcd4-4458-8686-bb140261e247 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c2fb208b56d4d52b59ac09873f16180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e8cac36a174b2eb5a6e53fdf25b4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:59:42.791594 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-ea867441-bcd4-4458-8686-bb140261e247 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59" status: 200 len: 1723 microversion: 2.1 time: 0.339200 May 26 14:59:42.792511 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 172/372] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:59:42 2021] GET /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59 => generated 1723 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:59:43.391813 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-fe4388be-7f0d-424a-b158-4b8830cc4929 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:59:43.392422 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-fe4388be-7f0d-424a-b158-4b8830cc4929 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 598b0e3f-8cf1-451a-80a8-ed7e5dd36984] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:43.400027 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-fe4388be-7f0d-424a-b158-4b8830cc4929 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:43.400475 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-fe4388be-7f0d-424a-b158-4b8830cc4929 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:43.401244 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-fe4388be-7f0d-424a-b158-4b8830cc4929 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:43.401989 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-fe4388be-7f0d-424a-b158-4b8830cc4929 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:43.619958 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-fe4388be-7f0d-424a-b158-4b8830cc4929 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:59:43.628553 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-fe4388be-7f0d-424a-b158-4b8830cc4929 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:59:43.630164 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-fe4388be-7f0d-424a-b158-4b8830cc4929 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:59:43.631351 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-fe4388be-7f0d-424a-b158-4b8830cc4929 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984" status: 200 len: 1722 microversion: 2.20 time: 0.243139 May 26 14:59:43.631840 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 201/373] 10.222.0.81 () {60 vars in 1277 bytes} [Wed May 26 14:59:43 2021] GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984 => generated 1722 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:59:43.808314 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-b9b5221e-21ec-49d8-bd8f-da0d22511059 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:59:43.808932 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-b9b5221e-21ec-49d8-bd8f-da0d22511059 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: a9d8f9a6-bd66-4caa-8662-4bb94655ae59] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:43.816311 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-41af7ffc-cf13-4e68-9a42-a53319ec865a tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:59:43.816922 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-41af7ffc-cf13-4e68-9a42-a53319ec865a tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] [instance: aa145a33-41b1-4e39-9642-132aca11fcfe] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:43.818077 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-b9b5221e-21ec-49d8-bd8f-da0d22511059 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:43.818631 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-b9b5221e-21ec-49d8-bd8f-da0d22511059 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:43.819418 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-b9b5221e-21ec-49d8-bd8f-da0d22511059 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:43.819855 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-b9b5221e-21ec-49d8-bd8f-da0d22511059 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:43.835377 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-41af7ffc-cf13-4e68-9a42-a53319ec865a tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:43.835505 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-41af7ffc-cf13-4e68-9a42-a53319ec865a tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:43.836504 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-41af7ffc-cf13-4e68-9a42-a53319ec865a tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:43.836652 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-41af7ffc-cf13-4e68-9a42-a53319ec865a tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:44.116405 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-b9b5221e-21ec-49d8-bd8f-da0d22511059 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c2fb208b56d4d52b59ac09873f16180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e8cac36a174b2eb5a6e53fdf25b4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:59:44.129067 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-b9b5221e-21ec-49d8-bd8f-da0d22511059 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59" status: 200 len: 1723 microversion: 2.1 time: 0.324441 May 26 14:59:44.130354 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 173/374] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:59:43 2021] GET /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59 => generated 1723 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:59:44.132708 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-41af7ffc-cf13-4e68-9a42-a53319ec865a tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b167942c895345b186a3eda5c82175b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad2ab2705ca479ab4aaafe7c80de162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:59:44.145983 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-41af7ffc-cf13-4e68-9a42-a53319ec865a tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /compute/v2.1/servers/aa145a33-41b1-4e39-9642-132aca11fcfe" status: 200 len: 1515 microversion: 2.1 time: 0.329158 May 26 14:59:44.145983 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 202/375] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:59:43 2021] GET /compute/v2.1/servers/aa145a33-41b1-4e39-9642-132aca11fcfe => generated 1515 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 14:59:44.160940 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-a995c85d-4b61-43e0-9e24-fee40c95ccda tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f0feefca-b280-4489-8686-ba0694fc3620"}} {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:59:44.162092 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-a995c85d-4b61-43e0-9e24-fee40c95ccda tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] [instance: aa145a33-41b1-4e39-9642-132aca11fcfe] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:44.169299 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-a995c85d-4b61-43e0-9e24-fee40c95ccda tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:44.169963 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-a995c85d-4b61-43e0-9e24-fee40c95ccda tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:44.170749 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-a995c85d-4b61-43e0-9e24-fee40c95ccda tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:44.171252 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-a995c85d-4b61-43e0-9e24-fee40c95ccda tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:44.221509 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-5cdc61aa-c613-445f-8751-cf4bef6e1ad5 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-348658228", "imageRef": "dcacad62-e278-4869-aa20-e5df07dd03db", "flavorRef": "452", "networks": [{"uuid": "5bdb145e-267b-43cd-9426-f92f373c5ed5"}]}} {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:59:44.302111 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.network.neutron [None req-5cdc61aa-c613-445f-8751-cf4bef6e1ad5 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] validate_networks() for [('5bdb145e-267b-43cd-9426-f92f373c5ed5', None, None, None)] {{(pid=118513) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} May 26 14:59:44.927195 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.virt.hardware [None req-5cdc61aa-c613-445f-8751-cf4bef6e1ad5 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Flavor limits 0:0:0 {{(pid=118513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} May 26 14:59:44.927796 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.virt.hardware [None req-5cdc61aa-c613-445f-8751-cf4bef6e1ad5 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Image limits 0:0:0 {{(pid=118513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} May 26 14:59:44.928504 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.virt.hardware [None req-5cdc61aa-c613-445f-8751-cf4bef6e1ad5 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Flavor pref 0:0:0 {{(pid=118513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} May 26 14:59:44.929004 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.virt.hardware [None req-5cdc61aa-c613-445f-8751-cf4bef6e1ad5 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Image pref 0:0:0 {{(pid=118513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} May 26 14:59:44.930007 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.virt.hardware [None req-5cdc61aa-c613-445f-8751-cf4bef6e1ad5 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} May 26 14:59:44.939875 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-5cdc61aa-c613-445f-8751-cf4bef6e1ad5 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:44.940608 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-5cdc61aa-c613-445f-8751-cf4bef6e1ad5 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:44.941704 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-5cdc61aa-c613-445f-8751-cf4bef6e1ad5 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:44.942366 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-5cdc61aa-c613-445f-8751-cf4bef6e1ad5 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:44.965777 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.quota [None req-5cdc61aa-c613-445f-8751-cf4bef6e1ad5 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Getting quotas for project 1515325707f64d58a28f26451b2c74de. Resources: {'instances', 'ram', 'cores'} {{(pid=118513) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 26 14:59:44.970360 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.quota [None req-5cdc61aa-c613-445f-8751-cf4bef6e1ad5 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Getting quotas for user 1be4bd5c0f2a400da491bae101b48832 and project 1515325707f64d58a28f26451b2c74de. Resources: {'instances', 'ram', 'cores'} {{(pid=118513) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 26 14:59:44.983653 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-5cdc61aa-c613-445f-8751-cf4bef6e1ad5 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Going to run 1 instances... {{(pid=118513) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 26 14:59:44.986931 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-5cdc61aa-c613-445f-8751-cf4bef6e1ad5 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] [instance: f4f8081b-28f4-4e9f-bf48-471d84e67da8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dcacad62-e278-4869-aa20-e5df07dd03db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118513) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} May 26 14:59:45.127636 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-5cdc61aa-c613-445f-8751-cf4bef6e1ad5 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.909682 May 26 14:59:45.130185 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 203/376] 10.222.0.81 () {60 vars in 1147 bytes} [Wed May 26 14:59:44 2021] POST /compute/v2.1/servers => generated 380 bytes in 913 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 26 14:59:45.139161 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-479379fc-05a8-4c29-86f4-5d8a3c0ded33 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:59:45.140016 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-479379fc-05a8-4c29-86f4-5d8a3c0ded33 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 598b0e3f-8cf1-451a-80a8-ed7e5dd36984] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:45.153253 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-479379fc-05a8-4c29-86f4-5d8a3c0ded33 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:45.153625 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-479379fc-05a8-4c29-86f4-5d8a3c0ded33 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:45.156501 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-479379fc-05a8-4c29-86f4-5d8a3c0ded33 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:45.156982 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-479379fc-05a8-4c29-86f4-5d8a3c0ded33 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:45.175589 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-a995c85d-4b61-43e0-9e24-fee40c95ccda tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "POST /compute/v2.1/servers/aa145a33-41b1-4e39-9642-132aca11fcfe/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.016707 May 26 14:59:45.176946 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 174/377] 10.222.0.81 () {60 vars in 1323 bytes} [Wed May 26 14:59:44 2021] POST /compute/v2.1/servers/aa145a33-41b1-4e39-9642-132aca11fcfe/os-volume_attachments => generated 194 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:59:45.189525 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-27c33c46-23db-4205-844e-bc5f71059602 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:59:45.192914 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-27c33c46-23db-4205-844e-bc5f71059602 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] [instance: f4f8081b-28f4-4e9f-bf48-471d84e67da8] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:45.339054 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-27c33c46-23db-4205-844e-bc5f71059602 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be4bd5c0f2a400da491bae101b48832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515325707f64d58a28f26451b2c74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:59:45.350863 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-27c33c46-23db-4205-844e-bc5f71059602 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /compute/v2.1/servers/f4f8081b-28f4-4e9f-bf48-471d84e67da8" status: 200 len: 1217 microversion: 2.1 time: 0.171537 May 26 14:59:45.361021 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 175/378] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:59:45 2021] GET /compute/v2.1/servers/f4f8081b-28f4-4e9f-bf48-471d84e67da8 => generated 1217 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:59:45.362534 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-77a8656b-16d7-4ead-94ee-9aac402ab1a2 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:59:45.363273 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-77a8656b-16d7-4ead-94ee-9aac402ab1a2 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: a9d8f9a6-bd66-4caa-8662-4bb94655ae59] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:45.372318 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-77a8656b-16d7-4ead-94ee-9aac402ab1a2 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:45.373075 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-77a8656b-16d7-4ead-94ee-9aac402ab1a2 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:45.374236 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-77a8656b-16d7-4ead-94ee-9aac402ab1a2 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:45.374865 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-77a8656b-16d7-4ead-94ee-9aac402ab1a2 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:45.469460 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-479379fc-05a8-4c29-86f4-5d8a3c0ded33 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:59:45.485821 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-479379fc-05a8-4c29-86f4-5d8a3c0ded33 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:59:45.493099 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-479379fc-05a8-4c29-86f4-5d8a3c0ded33 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:59:45.494399 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-479379fc-05a8-4c29-86f4-5d8a3c0ded33 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984" status: 200 len: 1722 microversion: 2.20 time: 0.363010 May 26 14:59:45.495197 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 204/379] 10.222.0.81 () {60 vars in 1277 bytes} [Wed May 26 14:59:45 2021] GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984 => generated 1722 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:59:45.772434 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-77a8656b-16d7-4ead-94ee-9aac402ab1a2 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c2fb208b56d4d52b59ac09873f16180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e8cac36a174b2eb5a6e53fdf25b4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:59:45.782506 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-77a8656b-16d7-4ead-94ee-9aac402ab1a2 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59" status: 200 len: 1723 microversion: 2.1 time: 0.427049 May 26 14:59:45.783374 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 176/380] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:59:45 2021] GET /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59 => generated 1723 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:59:46.368819 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-34ce3ba8-895d-4b7f-b7b5-609efcb366da tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:59:46.370160 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-34ce3ba8-895d-4b7f-b7b5-609efcb366da tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] [instance: f4f8081b-28f4-4e9f-bf48-471d84e67da8] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:46.379043 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-34ce3ba8-895d-4b7f-b7b5-609efcb366da tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:46.379753 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-34ce3ba8-895d-4b7f-b7b5-609efcb366da tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:46.380743 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-34ce3ba8-895d-4b7f-b7b5-609efcb366da tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:46.381332 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-34ce3ba8-895d-4b7f-b7b5-609efcb366da tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:46.513855 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-dffc5339-6c96-447f-97b1-1888024ec5fd tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:59:46.514756 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-dffc5339-6c96-447f-97b1-1888024ec5fd tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 598b0e3f-8cf1-451a-80a8-ed7e5dd36984] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:46.529959 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-dffc5339-6c96-447f-97b1-1888024ec5fd tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:46.539077 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-dffc5339-6c96-447f-97b1-1888024ec5fd tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:46.539077 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-dffc5339-6c96-447f-97b1-1888024ec5fd tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:46.539077 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-dffc5339-6c96-447f-97b1-1888024ec5fd tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:46.556474 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-34ce3ba8-895d-4b7f-b7b5-609efcb366da tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be4bd5c0f2a400da491bae101b48832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515325707f64d58a28f26451b2c74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:59:46.566309 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-34ce3ba8-895d-4b7f-b7b5-609efcb366da tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /compute/v2.1/servers/f4f8081b-28f4-4e9f-bf48-471d84e67da8" status: 200 len: 1221 microversion: 2.1 time: 0.201572 May 26 14:59:46.569053 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 205/381] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:59:46 2021] GET /compute/v2.1/servers/f4f8081b-28f4-4e9f-bf48-471d84e67da8 => generated 1221 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 14:59:46.778332 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-dffc5339-6c96-447f-97b1-1888024ec5fd tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:59:46.790465 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-dffc5339-6c96-447f-97b1-1888024ec5fd tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:59:46.792012 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-dffc5339-6c96-447f-97b1-1888024ec5fd tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:59:46.793420 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-dffc5339-6c96-447f-97b1-1888024ec5fd tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984" status: 200 len: 1722 microversion: 2.20 time: 0.283344 May 26 14:59:46.798256 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 177/382] 10.222.0.81 () {60 vars in 1277 bytes} [Wed May 26 14:59:46 2021] GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984 => generated 1722 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:59:46.800196 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-a17d1074-893e-4982-88d2-697f6120ce39 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:59:46.800864 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-a17d1074-893e-4982-88d2-697f6120ce39 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: a9d8f9a6-bd66-4caa-8662-4bb94655ae59] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:46.808103 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-a17d1074-893e-4982-88d2-697f6120ce39 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:46.808657 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-a17d1074-893e-4982-88d2-697f6120ce39 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:46.809512 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-a17d1074-893e-4982-88d2-697f6120ce39 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:46.809984 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-a17d1074-893e-4982-88d2-697f6120ce39 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:47.017080 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-a17d1074-893e-4982-88d2-697f6120ce39 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c2fb208b56d4d52b59ac09873f16180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e8cac36a174b2eb5a6e53fdf25b4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:59:47.026996 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-a17d1074-893e-4982-88d2-697f6120ce39 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59" status: 200 len: 1723 microversion: 2.1 time: 0.230404 May 26 14:59:47.027562 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 206/383] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:59:46 2021] GET /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59 => generated 1723 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:59:47.585452 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-98834d49-b56b-438f-bb2b-c69c0e98c5d1 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:59:47.586128 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-98834d49-b56b-438f-bb2b-c69c0e98c5d1 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] [instance: f4f8081b-28f4-4e9f-bf48-471d84e67da8] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:47.594283 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-98834d49-b56b-438f-bb2b-c69c0e98c5d1 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:47.599527 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-98834d49-b56b-438f-bb2b-c69c0e98c5d1 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:47.599527 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-98834d49-b56b-438f-bb2b-c69c0e98c5d1 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:47.599527 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-98834d49-b56b-438f-bb2b-c69c0e98c5d1 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:47.720068 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-98834d49-b56b-438f-bb2b-c69c0e98c5d1 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be4bd5c0f2a400da491bae101b48832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515325707f64d58a28f26451b2c74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:59:47.728631 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-98834d49-b56b-438f-bb2b-c69c0e98c5d1 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /compute/v2.1/servers/f4f8081b-28f4-4e9f-bf48-471d84e67da8" status: 200 len: 1277 microversion: 2.1 time: 0.147146 May 26 14:59:47.729583 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 178/384] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:59:47 2021] GET /compute/v2.1/servers/f4f8081b-28f4-4e9f-bf48-471d84e67da8 => generated 1277 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:59:47.816903 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-45394393-3603-4620-9ccc-1ddf4b82187a tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:59:47.817699 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-45394393-3603-4620-9ccc-1ddf4b82187a tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 598b0e3f-8cf1-451a-80a8-ed7e5dd36984] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:47.827274 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-45394393-3603-4620-9ccc-1ddf4b82187a tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:47.827875 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-45394393-3603-4620-9ccc-1ddf4b82187a tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:47.828742 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-45394393-3603-4620-9ccc-1ddf4b82187a tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:47.829333 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-45394393-3603-4620-9ccc-1ddf4b82187a tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:48.044091 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-3a160fff-d476-422a-aff5-e49057688997 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:59:48.044709 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-3a160fff-d476-422a-aff5-e49057688997 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: a9d8f9a6-bd66-4caa-8662-4bb94655ae59] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:48.052955 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-3a160fff-d476-422a-aff5-e49057688997 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:48.053416 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-3a160fff-d476-422a-aff5-e49057688997 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:48.054230 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-3a160fff-d476-422a-aff5-e49057688997 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:48.057304 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-45394393-3603-4620-9ccc-1ddf4b82187a tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:59:48.058001 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-3a160fff-d476-422a-aff5-e49057688997 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:48.069592 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-45394393-3603-4620-9ccc-1ddf4b82187a tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:59:48.069592 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-45394393-3603-4620-9ccc-1ddf4b82187a tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:59:48.069592 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-45394393-3603-4620-9ccc-1ddf4b82187a tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984" status: 200 len: 1722 microversion: 2.20 time: 0.256461 May 26 14:59:48.079875 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 207/385] 10.222.0.81 () {60 vars in 1277 bytes} [Wed May 26 14:59:47 2021] GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984 => generated 1722 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:59:48.311918 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-3a160fff-d476-422a-aff5-e49057688997 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c2fb208b56d4d52b59ac09873f16180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e8cac36a174b2eb5a6e53fdf25b4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:59:48.321700 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-3a160fff-d476-422a-aff5-e49057688997 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59" status: 200 len: 1723 microversion: 2.1 time: 0.281131 May 26 14:59:48.322288 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 179/386] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:59:48 2021] GET /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59 => generated 1723 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 14:59:48.746868 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-6bf5b53a-2c11-406f-b4a9-716a4439e836 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:59:48.747549 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-6bf5b53a-2c11-406f-b4a9-716a4439e836 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] [instance: f4f8081b-28f4-4e9f-bf48-471d84e67da8] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:48.758578 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-6bf5b53a-2c11-406f-b4a9-716a4439e836 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:48.770476 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-6bf5b53a-2c11-406f-b4a9-716a4439e836 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:48.771342 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-6bf5b53a-2c11-406f-b4a9-716a4439e836 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:48.771792 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-6bf5b53a-2c11-406f-b4a9-716a4439e836 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:48.815274 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-5c689254-dd30-4df1-a923-3ad576e0ad54 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1449453743", "imageRef": "dcacad62-e278-4869-aa20-e5df07dd03db", "flavorRef": "452", "networks": [{"uuid": "85b44080-2458-40a2-bbbd-894b0448370a"}]}} {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:59:48.936132 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.network.neutron [None req-5c689254-dd30-4df1-a923-3ad576e0ad54 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] validate_networks() for [('85b44080-2458-40a2-bbbd-894b0448370a', None, None, None)] {{(pid=118514) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} May 26 14:59:49.265438 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-6bf5b53a-2c11-406f-b4a9-716a4439e836 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be4bd5c0f2a400da491bae101b48832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515325707f64d58a28f26451b2c74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:59:49.277899 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-6bf5b53a-2c11-406f-b4a9-716a4439e836 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /compute/v2.1/servers/f4f8081b-28f4-4e9f-bf48-471d84e67da8" status: 200 len: 1317 microversion: 2.1 time: 0.534542 May 26 14:59:49.278925 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 208/387] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:59:48 2021] GET /compute/v2.1/servers/f4f8081b-28f4-4e9f-bf48-471d84e67da8 => generated 1317 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 14:59:49.284430 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-5d851bc4-7f9b-4a16-b815-6fa52257fbf2 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:59:49.288637 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-5d851bc4-7f9b-4a16-b815-6fa52257fbf2 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 598b0e3f-8cf1-451a-80a8-ed7e5dd36984] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:49.294199 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-5d851bc4-7f9b-4a16-b815-6fa52257fbf2 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:49.294810 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-5d851bc4-7f9b-4a16-b815-6fa52257fbf2 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:49.295759 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-5d851bc4-7f9b-4a16-b815-6fa52257fbf2 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:49.296343 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-5d851bc4-7f9b-4a16-b815-6fa52257fbf2 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:49.613219 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.virt.hardware [None req-5c689254-dd30-4df1-a923-3ad576e0ad54 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Flavor limits 0:0:0 {{(pid=118514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} May 26 14:59:49.613778 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.virt.hardware [None req-5c689254-dd30-4df1-a923-3ad576e0ad54 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Image limits 0:0:0 {{(pid=118514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} May 26 14:59:49.614390 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.virt.hardware [None req-5c689254-dd30-4df1-a923-3ad576e0ad54 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Flavor pref 0:0:0 {{(pid=118514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} May 26 14:59:49.614806 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.virt.hardware [None req-5c689254-dd30-4df1-a923-3ad576e0ad54 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Image pref 0:0:0 {{(pid=118514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} May 26 14:59:49.615219 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.virt.hardware [None req-5c689254-dd30-4df1-a923-3ad576e0ad54 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} May 26 14:59:49.623539 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-5c689254-dd30-4df1-a923-3ad576e0ad54 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:49.624104 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-5c689254-dd30-4df1-a923-3ad576e0ad54 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:49.624920 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-5c689254-dd30-4df1-a923-3ad576e0ad54 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:49.625358 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-5c689254-dd30-4df1-a923-3ad576e0ad54 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:49.643533 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.quota [None req-5c689254-dd30-4df1-a923-3ad576e0ad54 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Getting quotas for project dffd269c3a344d36b77ebb04d0c412e3. Resources: {'instances', 'ram', 'cores'} {{(pid=118514) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 26 14:59:49.647594 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.quota [None req-5c689254-dd30-4df1-a923-3ad576e0ad54 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Getting quotas for user 96610ea2bcf84875be6d08859dd0c7b4 and project dffd269c3a344d36b77ebb04d0c412e3. Resources: {'instances', 'ram', 'cores'} {{(pid=118514) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 26 14:59:49.658974 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-5c689254-dd30-4df1-a923-3ad576e0ad54 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Going to run 1 instances... {{(pid=118514) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 26 14:59:49.661461 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-5c689254-dd30-4df1-a923-3ad576e0ad54 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] [instance: 017ce180-3d28-4cea-8c40-c113c3627273] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dcacad62-e278-4869-aa20-e5df07dd03db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118514) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} May 26 14:59:49.762016 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-5d851bc4-7f9b-4a16-b815-6fa52257fbf2 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:59:49.778871 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-5d851bc4-7f9b-4a16-b815-6fa52257fbf2 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:59:49.780796 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-5d851bc4-7f9b-4a16-b815-6fa52257fbf2 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:59:49.781998 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-5d851bc4-7f9b-4a16-b815-6fa52257fbf2 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984" status: 200 len: 1722 microversion: 2.20 time: 0.501724 May 26 14:59:49.782545 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 209/388] 10.222.0.81 () {60 vars in 1277 bytes} [Wed May 26 14:59:49 2021] GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984 => generated 1722 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:59:49.786668 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-5c689254-dd30-4df1-a923-3ad576e0ad54 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.975885 May 26 14:59:49.790229 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-5727e7ff-d5e3-45fc-a606-5395b577aea6 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:59:49.791449 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 180/389] 10.222.0.81 () {60 vars in 1147 bytes} [Wed May 26 14:59:48 2021] POST /compute/v2.1/servers => generated 380 bytes in 981 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 14:59:49.792332 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-5727e7ff-d5e3-45fc-a606-5395b577aea6 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: a9d8f9a6-bd66-4caa-8662-4bb94655ae59] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:49.800887 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-68e2a2f1-47f0-4292-8011-8fdfa0e26558 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:59:49.801732 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-68e2a2f1-47f0-4292-8011-8fdfa0e26558 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] [instance: 017ce180-3d28-4cea-8c40-c113c3627273] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:49.809347 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-5727e7ff-d5e3-45fc-a606-5395b577aea6 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:49.809960 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-5727e7ff-d5e3-45fc-a606-5395b577aea6 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:49.810879 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-5727e7ff-d5e3-45fc-a606-5395b577aea6 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:49.811892 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-5727e7ff-d5e3-45fc-a606-5395b577aea6 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:49.897108 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-68e2a2f1-47f0-4292-8011-8fdfa0e26558 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96610ea2bcf84875be6d08859dd0c7b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dffd269c3a344d36b77ebb04d0c412e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:59:49.909684 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-68e2a2f1-47f0-4292-8011-8fdfa0e26558 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] 10.222.0.81 "GET /compute/v2.1/servers/017ce180-3d28-4cea-8c40-c113c3627273" status: 200 len: 1214 microversion: 2.1 time: 0.112143 May 26 14:59:49.919166 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 181/390] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:59:49 2021] GET /compute/v2.1/servers/017ce180-3d28-4cea-8c40-c113c3627273 => generated 1214 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 14:59:50.053929 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-5727e7ff-d5e3-45fc-a606-5395b577aea6 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c2fb208b56d4d52b59ac09873f16180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e8cac36a174b2eb5a6e53fdf25b4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:59:50.062747 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-5727e7ff-d5e3-45fc-a606-5395b577aea6 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59" status: 200 len: 1723 microversion: 2.1 time: 0.278018 May 26 14:59:50.063313 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 210/391] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:59:49 2021] GET /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59 => generated 1723 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:59:50.295940 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-17853031-d653-4f51-a534-849e8c249579 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:59:50.296675 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-17853031-d653-4f51-a534-849e8c249579 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] [instance: f4f8081b-28f4-4e9f-bf48-471d84e67da8] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:50.304382 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-17853031-d653-4f51-a534-849e8c249579 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:50.304842 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-17853031-d653-4f51-a534-849e8c249579 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:50.308816 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-17853031-d653-4f51-a534-849e8c249579 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:50.309281 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-17853031-d653-4f51-a534-849e8c249579 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:50.551666 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-17853031-d653-4f51-a534-849e8c249579 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be4bd5c0f2a400da491bae101b48832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515325707f64d58a28f26451b2c74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:59:50.567703 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-17853031-d653-4f51-a534-849e8c249579 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /compute/v2.1/servers/f4f8081b-28f4-4e9f-bf48-471d84e67da8" status: 200 len: 1317 microversion: 2.1 time: 0.269196 May 26 14:59:50.567703 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 182/392] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:59:50 2021] GET /compute/v2.1/servers/f4f8081b-28f4-4e9f-bf48-471d84e67da8 => generated 1317 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:59:50.801240 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-d933f5e3-5e22-49c1-952f-159d98f0e857 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:59:50.801884 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-d933f5e3-5e22-49c1-952f-159d98f0e857 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 598b0e3f-8cf1-451a-80a8-ed7e5dd36984] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:50.809938 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-d933f5e3-5e22-49c1-952f-159d98f0e857 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:50.810391 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-d933f5e3-5e22-49c1-952f-159d98f0e857 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:50.811182 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-d933f5e3-5e22-49c1-952f-159d98f0e857 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:50.811619 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-d933f5e3-5e22-49c1-952f-159d98f0e857 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:50.930858 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-7a1a6851-3558-4f5a-aa5a-6dd45b5998d3 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:59:50.931648 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-7a1a6851-3558-4f5a-aa5a-6dd45b5998d3 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] [instance: 017ce180-3d28-4cea-8c40-c113c3627273] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:51.009185 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-7a1a6851-3558-4f5a-aa5a-6dd45b5998d3 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96610ea2bcf84875be6d08859dd0c7b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dffd269c3a344d36b77ebb04d0c412e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:59:51.018214 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-7a1a6851-3558-4f5a-aa5a-6dd45b5998d3 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] 10.222.0.81 "GET /compute/v2.1/servers/017ce180-3d28-4cea-8c40-c113c3627273" status: 200 len: 1214 microversion: 2.1 time: 0.091037 May 26 14:59:51.018892 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 183/393] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:59:50 2021] GET /compute/v2.1/servers/017ce180-3d28-4cea-8c40-c113c3627273 => generated 1214 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 14:59:51.023941 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [req-07362afe-3a7d-4396-9e31-d3d41488ca4a req-d577ff1e-f44e-42fc-9eb4-43561a117143 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4f8081b-28f4-4e9f-bf48-471d84e67da8", "tag": "3ab2e391-3d42-467d-8e80-fe132717746c"}]} {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:59:51.025882 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 14:59:51.025882 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: warnings.warn(msg) May 26 14:59:51.041605 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [req-07362afe-3a7d-4396-9e31-d3d41488ca4a req-d577ff1e-f44e-42fc-9eb4-43561a117143 service nova] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:51.041605 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [req-07362afe-3a7d-4396-9e31-d3d41488ca4a req-d577ff1e-f44e-42fc-9eb4-43561a117143 service nova] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:51.061842 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.compute.server_external_events [req-07362afe-3a7d-4396-9e31-d3d41488ca4a req-d577ff1e-f44e-42fc-9eb4-43561a117143 service nova] Creating event network-changed:3ab2e391-3d42-467d-8e80-fe132717746c for instance f4f8081b-28f4-4e9f-bf48-471d84e67da8 on hv-cinder-78414 May 26 14:59:51.067460 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [req-07362afe-3a7d-4396-9e31-d3d41488ca4a req-d577ff1e-f44e-42fc-9eb4-43561a117143 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047117 May 26 14:59:51.068275 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 184/394] 10.222.0.81 () {64 vars in 1318 bytes} [Wed May 26 14:59:51 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:59:51.087932 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-43135e71-750c-496c-9d2f-19da9db98055 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:59:51.088999 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-43135e71-750c-496c-9d2f-19da9db98055 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: a9d8f9a6-bd66-4caa-8662-4bb94655ae59] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:51.099267 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-43135e71-750c-496c-9d2f-19da9db98055 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:51.100004 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-43135e71-750c-496c-9d2f-19da9db98055 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:51.101714 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-43135e71-750c-496c-9d2f-19da9db98055 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:51.102379 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-43135e71-750c-496c-9d2f-19da9db98055 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:51.175590 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-d933f5e3-5e22-49c1-952f-159d98f0e857 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:59:51.185226 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-d933f5e3-5e22-49c1-952f-159d98f0e857 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:59:51.186789 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-d933f5e3-5e22-49c1-952f-159d98f0e857 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:59:51.188187 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-d933f5e3-5e22-49c1-952f-159d98f0e857 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984" status: 200 len: 1722 microversion: 2.20 time: 0.391533 May 26 14:59:51.190792 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 211/395] 10.222.0.81 () {60 vars in 1277 bytes} [Wed May 26 14:59:50 2021] GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984 => generated 1722 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:59:51.368595 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-43135e71-750c-496c-9d2f-19da9db98055 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c2fb208b56d4d52b59ac09873f16180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e8cac36a174b2eb5a6e53fdf25b4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:59:51.377813 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-43135e71-750c-496c-9d2f-19da9db98055 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59" status: 200 len: 1723 microversion: 2.1 time: 0.298532 May 26 14:59:51.378815 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 185/396] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:59:51 2021] GET /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59 => generated 1723 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:59:51.583359 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-28f61610-b4a3-4cfb-be2f-842b10d63183 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:59:51.584091 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-28f61610-b4a3-4cfb-be2f-842b10d63183 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] [instance: f4f8081b-28f4-4e9f-bf48-471d84e67da8] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:51.603638 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-28f61610-b4a3-4cfb-be2f-842b10d63183 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:51.604102 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-28f61610-b4a3-4cfb-be2f-842b10d63183 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:51.604896 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-28f61610-b4a3-4cfb-be2f-842b10d63183 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:51.605341 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-28f61610-b4a3-4cfb-be2f-842b10d63183 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:51.966468 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-28f61610-b4a3-4cfb-be2f-842b10d63183 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be4bd5c0f2a400da491bae101b48832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515325707f64d58a28f26451b2c74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:59:51.976535 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-28f61610-b4a3-4cfb-be2f-842b10d63183 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /compute/v2.1/servers/f4f8081b-28f4-4e9f-bf48-471d84e67da8" status: 200 len: 1317 microversion: 2.1 time: 0.397520 May 26 14:59:51.977433 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 212/397] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:59:51 2021] GET /compute/v2.1/servers/f4f8081b-28f4-4e9f-bf48-471d84e67da8 => generated 1317 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:59:52.039988 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-4c704db3-a198-4eb0-a679-b1c5c45bf962 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:59:52.041839 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-4c704db3-a198-4eb0-a679-b1c5c45bf962 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] [instance: 017ce180-3d28-4cea-8c40-c113c3627273] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:52.051549 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-4c704db3-a198-4eb0-a679-b1c5c45bf962 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:52.052000 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-4c704db3-a198-4eb0-a679-b1c5c45bf962 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:52.052814 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-4c704db3-a198-4eb0-a679-b1c5c45bf962 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:52.053246 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-4c704db3-a198-4eb0-a679-b1c5c45bf962 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:52.196918 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-4c704db3-a198-4eb0-a679-b1c5c45bf962 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96610ea2bcf84875be6d08859dd0c7b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dffd269c3a344d36b77ebb04d0c412e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:59:52.206833 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-569141d2-b52c-483e-9e54-e85b9c03fba8 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:59:52.207443 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-569141d2-b52c-483e-9e54-e85b9c03fba8 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 598b0e3f-8cf1-451a-80a8-ed7e5dd36984] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:52.221016 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-4c704db3-a198-4eb0-a679-b1c5c45bf962 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] 10.222.0.81 "GET /compute/v2.1/servers/017ce180-3d28-4cea-8c40-c113c3627273" status: 200 len: 1266 microversion: 2.1 time: 0.187432 May 26 14:59:52.229822 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 186/398] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:59:52 2021] GET /compute/v2.1/servers/017ce180-3d28-4cea-8c40-c113c3627273 => generated 1266 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:59:52.230074 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-569141d2-b52c-483e-9e54-e85b9c03fba8 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:52.232116 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-569141d2-b52c-483e-9e54-e85b9c03fba8 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:52.233641 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-569141d2-b52c-483e-9e54-e85b9c03fba8 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:52.234252 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-569141d2-b52c-483e-9e54-e85b9c03fba8 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:52.397903 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-2d99d7fc-6d85-4eea-8cf5-8a9c3210ce24 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:59:52.398957 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-2d99d7fc-6d85-4eea-8cf5-8a9c3210ce24 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: a9d8f9a6-bd66-4caa-8662-4bb94655ae59] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:52.411232 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-2d99d7fc-6d85-4eea-8cf5-8a9c3210ce24 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:52.412173 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-2d99d7fc-6d85-4eea-8cf5-8a9c3210ce24 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:52.413285 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-2d99d7fc-6d85-4eea-8cf5-8a9c3210ce24 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:52.414164 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-2d99d7fc-6d85-4eea-8cf5-8a9c3210ce24 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:52.591678 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-569141d2-b52c-483e-9e54-e85b9c03fba8 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:59:52.601002 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-569141d2-b52c-483e-9e54-e85b9c03fba8 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:59:52.603046 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-569141d2-b52c-483e-9e54-e85b9c03fba8 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:59:52.604779 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-569141d2-b52c-483e-9e54-e85b9c03fba8 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984" status: 200 len: 1722 microversion: 2.20 time: 0.402246 May 26 14:59:52.605581 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 213/399] 10.222.0.81 () {60 vars in 1277 bytes} [Wed May 26 14:59:52 2021] GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984 => generated 1722 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:59:52.993251 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-5b7c1f3e-cc95-440f-8bb8-f0aff0f0e973 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:59:52.994641 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-5b7c1f3e-cc95-440f-8bb8-f0aff0f0e973 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] [instance: f4f8081b-28f4-4e9f-bf48-471d84e67da8] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:53.003357 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-5b7c1f3e-cc95-440f-8bb8-f0aff0f0e973 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:53.004102 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-5b7c1f3e-cc95-440f-8bb8-f0aff0f0e973 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:53.005139 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-5b7c1f3e-cc95-440f-8bb8-f0aff0f0e973 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:53.005851 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-5b7c1f3e-cc95-440f-8bb8-f0aff0f0e973 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:53.030457 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-2d99d7fc-6d85-4eea-8cf5-8a9c3210ce24 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c2fb208b56d4d52b59ac09873f16180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e8cac36a174b2eb5a6e53fdf25b4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:59:53.045692 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-2d99d7fc-6d85-4eea-8cf5-8a9c3210ce24 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59" status: 200 len: 1723 microversion: 2.1 time: 0.653811 May 26 14:59:53.050217 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 187/400] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:59:52 2021] GET /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59 => generated 1723 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 14:59:53.243308 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-886dcdba-cef2-4cd5-b2c0-a09a1e8dd05d tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:59:53.243948 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-886dcdba-cef2-4cd5-b2c0-a09a1e8dd05d tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] [instance: 017ce180-3d28-4cea-8c40-c113c3627273] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:53.251421 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-886dcdba-cef2-4cd5-b2c0-a09a1e8dd05d tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:53.257764 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-886dcdba-cef2-4cd5-b2c0-a09a1e8dd05d tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:53.257764 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-886dcdba-cef2-4cd5-b2c0-a09a1e8dd05d tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:53.257764 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-886dcdba-cef2-4cd5-b2c0-a09a1e8dd05d tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:53.427666 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-886dcdba-cef2-4cd5-b2c0-a09a1e8dd05d tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96610ea2bcf84875be6d08859dd0c7b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dffd269c3a344d36b77ebb04d0c412e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:59:53.440862 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-886dcdba-cef2-4cd5-b2c0-a09a1e8dd05d tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] 10.222.0.81 "GET /compute/v2.1/servers/017ce180-3d28-4cea-8c40-c113c3627273" status: 200 len: 1284 microversion: 2.1 time: 0.205852 May 26 14:59:53.441455 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 188/401] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:59:53 2021] GET /compute/v2.1/servers/017ce180-3d28-4cea-8c40-c113c3627273 => generated 1284 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:59:53.552928 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-5b7c1f3e-cc95-440f-8bb8-f0aff0f0e973 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be4bd5c0f2a400da491bae101b48832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515325707f64d58a28f26451b2c74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:59:53.565577 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-5b7c1f3e-cc95-440f-8bb8-f0aff0f0e973 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /compute/v2.1/servers/f4f8081b-28f4-4e9f-bf48-471d84e67da8" status: 200 len: 1317 microversion: 2.1 time: 0.575805 May 26 14:59:53.566220 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 214/402] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:59:52 2021] GET /compute/v2.1/servers/f4f8081b-28f4-4e9f-bf48-471d84e67da8 => generated 1317 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 14:59:53.627903 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-eef006ad-9608-4ec8-a5a8-8f462b876239 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:59:53.627903 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-eef006ad-9608-4ec8-a5a8-8f462b876239 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 598b0e3f-8cf1-451a-80a8-ed7e5dd36984] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:53.634943 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-eef006ad-9608-4ec8-a5a8-8f462b876239 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:53.635499 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-eef006ad-9608-4ec8-a5a8-8f462b876239 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:53.636444 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-eef006ad-9608-4ec8-a5a8-8f462b876239 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:53.637112 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-eef006ad-9608-4ec8-a5a8-8f462b876239 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:54.008010 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-eef006ad-9608-4ec8-a5a8-8f462b876239 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:59:54.018946 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-eef006ad-9608-4ec8-a5a8-8f462b876239 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:59:54.025341 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-eef006ad-9608-4ec8-a5a8-8f462b876239 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:59:54.025341 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-eef006ad-9608-4ec8-a5a8-8f462b876239 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984" status: 200 len: 1722 microversion: 2.20 time: 0.402035 May 26 14:59:54.025341 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 189/403] 10.222.0.81 () {60 vars in 1277 bytes} [Wed May 26 14:59:53 2021] GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984 => generated 1722 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:59:54.063878 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-b6163928-c2ec-4676-a4a6-e5df0edf221b tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:59:54.065493 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-b6163928-c2ec-4676-a4a6-e5df0edf221b tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: a9d8f9a6-bd66-4caa-8662-4bb94655ae59] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:54.078716 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-b6163928-c2ec-4676-a4a6-e5df0edf221b tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:54.079334 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-b6163928-c2ec-4676-a4a6-e5df0edf221b tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:54.081383 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-b6163928-c2ec-4676-a4a6-e5df0edf221b tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:54.082145 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-b6163928-c2ec-4676-a4a6-e5df0edf221b tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:54.351264 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-b55f58e4-3e39-4378-9ff4-53f9632f9481 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:59:54.352419 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-b55f58e4-3e39-4378-9ff4-53f9632f9481 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] [instance: aa145a33-41b1-4e39-9642-132aca11fcfe] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:54.362895 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-b55f58e4-3e39-4378-9ff4-53f9632f9481 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:54.363900 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-b55f58e4-3e39-4378-9ff4-53f9632f9481 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:54.364928 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-b55f58e4-3e39-4378-9ff4-53f9632f9481 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:54.365620 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-b55f58e4-3e39-4378-9ff4-53f9632f9481 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:54.377869 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-b6163928-c2ec-4676-a4a6-e5df0edf221b tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c2fb208b56d4d52b59ac09873f16180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e8cac36a174b2eb5a6e53fdf25b4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:59:54.402558 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-b6163928-c2ec-4676-a4a6-e5df0edf221b tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59" status: 200 len: 1723 microversion: 2.1 time: 0.342328 May 26 14:59:54.413343 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 215/404] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:59:54 2021] GET /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59 => generated 1723 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:59:54.471217 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-331b0d13-0c69-422f-bcdb-9819340cec44 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:59:54.472142 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-331b0d13-0c69-422f-bcdb-9819340cec44 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] [instance: 017ce180-3d28-4cea-8c40-c113c3627273] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:54.480031 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.objects.instance [None req-b55f58e4-3e39-4378-9ff4-53f9632f9481 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lazy-loading 'flavor' on Instance uuid aa145a33-41b1-4e39-9642-132aca11fcfe {{(pid=118514) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 26 14:59:54.487135 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-331b0d13-0c69-422f-bcdb-9819340cec44 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:54.487135 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-331b0d13-0c69-422f-bcdb-9819340cec44 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:54.487135 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-331b0d13-0c69-422f-bcdb-9819340cec44 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:54.487135 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-331b0d13-0c69-422f-bcdb-9819340cec44 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:54.998908 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-331b0d13-0c69-422f-bcdb-9819340cec44 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96610ea2bcf84875be6d08859dd0c7b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dffd269c3a344d36b77ebb04d0c412e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:59:55.008809 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-331b0d13-0c69-422f-bcdb-9819340cec44 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] 10.222.0.81 "GET /compute/v2.1/servers/017ce180-3d28-4cea-8c40-c113c3627273" status: 200 len: 1314 microversion: 2.1 time: 0.547850 May 26 14:59:55.012768 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 216/405] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:59:54 2021] GET /compute/v2.1/servers/017ce180-3d28-4cea-8c40-c113c3627273 => generated 1314 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:59:55.017623 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-d29e1433-1b12-4cbd-b6e4-2acbd421b236 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:59:55.018318 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-d29e1433-1b12-4cbd-b6e4-2acbd421b236 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] [instance: f4f8081b-28f4-4e9f-bf48-471d84e67da8] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:55.035227 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-d29e1433-1b12-4cbd-b6e4-2acbd421b236 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:55.036006 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-d29e1433-1b12-4cbd-b6e4-2acbd421b236 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:55.037140 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-d29e1433-1b12-4cbd-b6e4-2acbd421b236 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:55.037827 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-d29e1433-1b12-4cbd-b6e4-2acbd421b236 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:55.131776 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-b55f58e4-3e39-4378-9ff4-53f9632f9481 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "POST /compute/v2.1/servers/aa145a33-41b1-4e39-9642-132aca11fcfe/action" status: 200 len: 32 microversion: 2.1 time: 0.784380 May 26 14:59:55.133986 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 190/406] 10.222.0.81 () {60 vars in 1278 bytes} [Wed May 26 14:59:54 2021] POST /compute/v2.1/servers/aa145a33-41b1-4e39-9642-132aca11fcfe/action => generated 32 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 26 14:59:55.141956 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-414946e3-7f32-4b6e-aa9a-2cd2c339cb3f tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:59:55.143515 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-414946e3-7f32-4b6e-aa9a-2cd2c339cb3f tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 598b0e3f-8cf1-451a-80a8-ed7e5dd36984] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:55.154621 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-414946e3-7f32-4b6e-aa9a-2cd2c339cb3f tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:55.155174 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-414946e3-7f32-4b6e-aa9a-2cd2c339cb3f tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:55.156039 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-414946e3-7f32-4b6e-aa9a-2cd2c339cb3f tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:55.156556 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-414946e3-7f32-4b6e-aa9a-2cd2c339cb3f tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:55.330049 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-d29e1433-1b12-4cbd-b6e4-2acbd421b236 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be4bd5c0f2a400da491bae101b48832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515325707f64d58a28f26451b2c74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:59:55.339623 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-d29e1433-1b12-4cbd-b6e4-2acbd421b236 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /compute/v2.1/servers/f4f8081b-28f4-4e9f-bf48-471d84e67da8" status: 200 len: 1317 microversion: 2.1 time: 0.325588 May 26 14:59:55.341530 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 217/407] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:59:55 2021] GET /compute/v2.1/servers/f4f8081b-28f4-4e9f-bf48-471d84e67da8 => generated 1317 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:59:55.347207 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-5bffcaf8-711b-4f1e-918f-9c48f277e33b tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:59:55.348001 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-5bffcaf8-711b-4f1e-918f-9c48f277e33b tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] [instance: aa145a33-41b1-4e39-9642-132aca11fcfe] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:55.355775 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-5bffcaf8-711b-4f1e-918f-9c48f277e33b tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:55.356483 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-5bffcaf8-711b-4f1e-918f-9c48f277e33b tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:55.362352 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-5bffcaf8-711b-4f1e-918f-9c48f277e33b tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:55.362352 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-5bffcaf8-711b-4f1e-918f-9c48f277e33b tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:55.808209 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-414946e3-7f32-4b6e-aa9a-2cd2c339cb3f tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:59:55.823694 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-414946e3-7f32-4b6e-aa9a-2cd2c339cb3f tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:59:55.825495 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-414946e3-7f32-4b6e-aa9a-2cd2c339cb3f tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:59:55.826767 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-414946e3-7f32-4b6e-aa9a-2cd2c339cb3f tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984" status: 200 len: 1743 microversion: 2.20 time: 0.691391 May 26 14:59:55.827397 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 191/408] 10.222.0.81 () {60 vars in 1277 bytes} [Wed May 26 14:59:55 2021] GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984 => generated 1743 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:59:55.833920 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-e76c8c66-60cf-4a77-b3be-10e0aee2d5e6 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:59:55.834735 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-e76c8c66-60cf-4a77-b3be-10e0aee2d5e6 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: a9d8f9a6-bd66-4caa-8662-4bb94655ae59] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:55.845099 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-e76c8c66-60cf-4a77-b3be-10e0aee2d5e6 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:55.847014 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-e76c8c66-60cf-4a77-b3be-10e0aee2d5e6 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:55.847995 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-e76c8c66-60cf-4a77-b3be-10e0aee2d5e6 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:55.848614 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-e76c8c66-60cf-4a77-b3be-10e0aee2d5e6 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:55.862646 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-5bffcaf8-711b-4f1e-918f-9c48f277e33b tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b167942c895345b186a3eda5c82175b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad2ab2705ca479ab4aaafe7c80de162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:59:55.872536 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-5bffcaf8-711b-4f1e-918f-9c48f277e33b tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /compute/v2.1/servers/aa145a33-41b1-4e39-9642-132aca11fcfe" status: 200 len: 1567 microversion: 2.1 time: 0.529577 May 26 14:59:55.873391 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 218/409] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:59:55 2021] GET /compute/v2.1/servers/aa145a33-41b1-4e39-9642-132aca11fcfe => generated 1567 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:59:56.032209 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-7b3f9530-e4e6-4981-8ffd-acbef6c38dd0 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:59:56.032890 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-7b3f9530-e4e6-4981-8ffd-acbef6c38dd0 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] [instance: 017ce180-3d28-4cea-8c40-c113c3627273] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:56.041134 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-7b3f9530-e4e6-4981-8ffd-acbef6c38dd0 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:56.041627 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-7b3f9530-e4e6-4981-8ffd-acbef6c38dd0 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:56.042560 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-7b3f9530-e4e6-4981-8ffd-acbef6c38dd0 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:56.043205 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-7b3f9530-e4e6-4981-8ffd-acbef6c38dd0 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:56.401958 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-7b3f9530-e4e6-4981-8ffd-acbef6c38dd0 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96610ea2bcf84875be6d08859dd0c7b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dffd269c3a344d36b77ebb04d0c412e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:59:56.412102 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-7b3f9530-e4e6-4981-8ffd-acbef6c38dd0 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] 10.222.0.81 "GET /compute/v2.1/servers/017ce180-3d28-4cea-8c40-c113c3627273" status: 200 len: 1314 microversion: 2.1 time: 0.383507 May 26 14:59:56.413407 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 219/410] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:59:56 2021] GET /compute/v2.1/servers/017ce180-3d28-4cea-8c40-c113c3627273 => generated 1314 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 14:59:56.426459 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [req-34ffb421-371a-4339-99b1-7928f5d8f63b req-a6d6a3fa-c78c-448c-9aad-0875a98a00ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "017ce180-3d28-4cea-8c40-c113c3627273", "tag": "717c230d-741b-4c4f-abf3-9fd63dc119c4"}]} {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:59:56.428499 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 14:59:56.428499 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: warnings.warn(msg) May 26 14:59:56.437590 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [req-34ffb421-371a-4339-99b1-7928f5d8f63b req-a6d6a3fa-c78c-448c-9aad-0875a98a00ee service nova] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:56.438382 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [req-34ffb421-371a-4339-99b1-7928f5d8f63b req-a6d6a3fa-c78c-448c-9aad-0875a98a00ee service nova] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:56.456494 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.compute.server_external_events [req-34ffb421-371a-4339-99b1-7928f5d8f63b req-a6d6a3fa-c78c-448c-9aad-0875a98a00ee service nova] Creating event network-changed:717c230d-741b-4c4f-abf3-9fd63dc119c4 for instance 017ce180-3d28-4cea-8c40-c113c3627273 on hv-cinder-78414 May 26 14:59:56.462161 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [req-34ffb421-371a-4339-99b1-7928f5d8f63b req-a6d6a3fa-c78c-448c-9aad-0875a98a00ee service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047230 May 26 14:59:56.463398 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 220/411] 10.222.0.81 () {64 vars in 1318 bytes} [Wed May 26 14:59:56 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 14:59:56.469889 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-df542c50-fa6b-43fe-b08d-fba33932cf05 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:59:56.471588 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-df542c50-fa6b-43fe-b08d-fba33932cf05 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] [instance: f4f8081b-28f4-4e9f-bf48-471d84e67da8] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:56.480429 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-df542c50-fa6b-43fe-b08d-fba33932cf05 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:56.480980 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-df542c50-fa6b-43fe-b08d-fba33932cf05 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:56.481898 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-df542c50-fa6b-43fe-b08d-fba33932cf05 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:56.482422 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-df542c50-fa6b-43fe-b08d-fba33932cf05 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:56.643542 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-e76c8c66-60cf-4a77-b3be-10e0aee2d5e6 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c2fb208b56d4d52b59ac09873f16180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e8cac36a174b2eb5a6e53fdf25b4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:59:56.655674 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-e76c8c66-60cf-4a77-b3be-10e0aee2d5e6 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59" status: 200 len: 1723 microversion: 2.1 time: 0.826892 May 26 14:59:56.657162 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 192/412] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:59:55 2021] GET /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59 => generated 1723 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:59:56.850845 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-dd3c0d32-117d-46b5-8ff8-6442ed2d5b47 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:59:56.851531 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-dd3c0d32-117d-46b5-8ff8-6442ed2d5b47 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 598b0e3f-8cf1-451a-80a8-ed7e5dd36984] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:56.858944 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-dd3c0d32-117d-46b5-8ff8-6442ed2d5b47 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:56.859604 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-dd3c0d32-117d-46b5-8ff8-6442ed2d5b47 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:56.860575 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-dd3c0d32-117d-46b5-8ff8-6442ed2d5b47 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:56.862434 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-dd3c0d32-117d-46b5-8ff8-6442ed2d5b47 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:57.198680 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-dd3c0d32-117d-46b5-8ff8-6442ed2d5b47 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:59:57.211972 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-dd3c0d32-117d-46b5-8ff8-6442ed2d5b47 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:59:57.213518 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-dd3c0d32-117d-46b5-8ff8-6442ed2d5b47 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:59:57.215756 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-dd3c0d32-117d-46b5-8ff8-6442ed2d5b47 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984" status: 200 len: 1743 microversion: 2.20 time: 0.368651 May 26 14:59:57.222019 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-df542c50-fa6b-43fe-b08d-fba33932cf05 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be4bd5c0f2a400da491bae101b48832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515325707f64d58a28f26451b2c74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:59:57.229073 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 193/413] 10.222.0.81 () {60 vars in 1277 bytes} [Wed May 26 14:59:56 2021] GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984 => generated 1743 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 14:59:57.235963 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-06908040-0183-4cb9-b5ba-d7f37e02b236 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:59:57.237036 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-06908040-0183-4cb9-b5ba-d7f37e02b236 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] [instance: aa145a33-41b1-4e39-9642-132aca11fcfe] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:57.246581 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-06908040-0183-4cb9-b5ba-d7f37e02b236 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:57.247043 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-06908040-0183-4cb9-b5ba-d7f37e02b236 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:57.247846 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-06908040-0183-4cb9-b5ba-d7f37e02b236 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:57.247970 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-df542c50-fa6b-43fe-b08d-fba33932cf05 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /compute/v2.1/servers/f4f8081b-28f4-4e9f-bf48-471d84e67da8" status: 200 len: 1317 microversion: 2.1 time: 0.783109 May 26 14:59:57.248295 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-06908040-0183-4cb9-b5ba-d7f37e02b236 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:57.248558 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 221/414] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:59:56 2021] GET /compute/v2.1/servers/f4f8081b-28f4-4e9f-bf48-471d84e67da8 => generated 1317 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:59:57.431312 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-6416f795-9b30-4cfe-8fa6-d13c9abd2680 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:59:57.432273 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-6416f795-9b30-4cfe-8fa6-d13c9abd2680 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] [instance: 017ce180-3d28-4cea-8c40-c113c3627273] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:57.443682 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-6416f795-9b30-4cfe-8fa6-d13c9abd2680 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:57.446888 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-6416f795-9b30-4cfe-8fa6-d13c9abd2680 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:57.447719 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-6416f795-9b30-4cfe-8fa6-d13c9abd2680 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:57.450096 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-6416f795-9b30-4cfe-8fa6-d13c9abd2680 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:57.544509 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-06908040-0183-4cb9-b5ba-d7f37e02b236 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b167942c895345b186a3eda5c82175b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad2ab2705ca479ab4aaafe7c80de162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:59:57.555686 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-06908040-0183-4cb9-b5ba-d7f37e02b236 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /compute/v2.1/servers/aa145a33-41b1-4e39-9642-132aca11fcfe" status: 200 len: 1567 microversion: 2.1 time: 0.324891 May 26 14:59:57.556332 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 194/415] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:59:57 2021] GET /compute/v2.1/servers/aa145a33-41b1-4e39-9642-132aca11fcfe => generated 1567 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:59:57.675238 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-2c9c38af-895b-4e23-9093-03878e603401 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:59:57.675871 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-2c9c38af-895b-4e23-9093-03878e603401 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: a9d8f9a6-bd66-4caa-8662-4bb94655ae59] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:57.684878 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-2c9c38af-895b-4e23-9093-03878e603401 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:57.686768 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-2c9c38af-895b-4e23-9093-03878e603401 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:57.686768 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-2c9c38af-895b-4e23-9093-03878e603401 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:57.687271 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-2c9c38af-895b-4e23-9093-03878e603401 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:58.042046 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-6416f795-9b30-4cfe-8fa6-d13c9abd2680 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96610ea2bcf84875be6d08859dd0c7b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dffd269c3a344d36b77ebb04d0c412e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:59:58.060167 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-6416f795-9b30-4cfe-8fa6-d13c9abd2680 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] 10.222.0.81 "GET /compute/v2.1/servers/017ce180-3d28-4cea-8c40-c113c3627273" status: 200 len: 1314 microversion: 2.1 time: 0.633831 May 26 14:59:58.060760 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 222/416] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:59:57 2021] GET /compute/v2.1/servers/017ce180-3d28-4cea-8c40-c113c3627273 => generated 1314 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 14:59:58.191016 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-2c9c38af-895b-4e23-9093-03878e603401 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c2fb208b56d4d52b59ac09873f16180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e8cac36a174b2eb5a6e53fdf25b4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:59:58.207571 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-2c9c38af-895b-4e23-9093-03878e603401 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59" status: 200 len: 1723 microversion: 2.1 time: 0.537329 May 26 14:59:58.208173 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 195/417] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:59:57 2021] GET /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59 => generated 1723 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:59:58.234772 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-97f70192-4315-41b8-a749-bfbb2ab0ee28 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:59:58.235401 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-97f70192-4315-41b8-a749-bfbb2ab0ee28 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 598b0e3f-8cf1-451a-80a8-ed7e5dd36984] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:58.249838 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-97f70192-4315-41b8-a749-bfbb2ab0ee28 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:58.250304 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-97f70192-4315-41b8-a749-bfbb2ab0ee28 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:58.251127 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-97f70192-4315-41b8-a749-bfbb2ab0ee28 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:58.252478 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-97f70192-4315-41b8-a749-bfbb2ab0ee28 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:58.264276 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-288e6910-094f-4cec-8a52-29222e81e516 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:59:58.265056 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-288e6910-094f-4cec-8a52-29222e81e516 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] [instance: f4f8081b-28f4-4e9f-bf48-471d84e67da8] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:58.283299 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-288e6910-094f-4cec-8a52-29222e81e516 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:58.284170 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-288e6910-094f-4cec-8a52-29222e81e516 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:58.285004 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-288e6910-094f-4cec-8a52-29222e81e516 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:58.285736 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-288e6910-094f-4cec-8a52-29222e81e516 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:58.727747 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-288e6910-094f-4cec-8a52-29222e81e516 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be4bd5c0f2a400da491bae101b48832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515325707f64d58a28f26451b2c74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:59:58.743860 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-288e6910-094f-4cec-8a52-29222e81e516 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /compute/v2.1/servers/f4f8081b-28f4-4e9f-bf48-471d84e67da8" status: 200 len: 1317 microversion: 2.1 time: 0.481274 May 26 14:59:58.746330 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 196/418] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:59:58 2021] GET /compute/v2.1/servers/f4f8081b-28f4-4e9f-bf48-471d84e67da8 => generated 1317 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 14:59:58.750902 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-94df9921-7e62-4285-8680-00e18085b5ed tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:59:58.751762 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-94df9921-7e62-4285-8680-00e18085b5ed tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] [instance: aa145a33-41b1-4e39-9642-132aca11fcfe] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:58.769399 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-94df9921-7e62-4285-8680-00e18085b5ed tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:58.770097 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-94df9921-7e62-4285-8680-00e18085b5ed tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:58.771168 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-94df9921-7e62-4285-8680-00e18085b5ed tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:58.771768 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-94df9921-7e62-4285-8680-00e18085b5ed tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:59.239048 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-94df9921-7e62-4285-8680-00e18085b5ed tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b167942c895345b186a3eda5c82175b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad2ab2705ca479ab4aaafe7c80de162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:59:59.252196 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-94df9921-7e62-4285-8680-00e18085b5ed tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /compute/v2.1/servers/aa145a33-41b1-4e39-9642-132aca11fcfe" status: 200 len: 1567 microversion: 2.1 time: 0.504133 May 26 14:59:59.253972 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 197/419] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:59:58 2021] GET /compute/v2.1/servers/aa145a33-41b1-4e39-9642-132aca11fcfe => generated 1567 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:59:59.263612 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-771eef87-b22c-49e9-9f03-c477559ba77c tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:59:59.264978 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-771eef87-b22c-49e9-9f03-c477559ba77c tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] [instance: 017ce180-3d28-4cea-8c40-c113c3627273] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:59.283289 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-771eef87-b22c-49e9-9f03-c477559ba77c tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:59.284025 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-771eef87-b22c-49e9-9f03-c477559ba77c tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:59.290245 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-771eef87-b22c-49e9-9f03-c477559ba77c tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:59.291214 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-771eef87-b22c-49e9-9f03-c477559ba77c tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:59.485074 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-97f70192-4315-41b8-a749-bfbb2ab0ee28 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:59:59.498712 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-97f70192-4315-41b8-a749-bfbb2ab0ee28 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:59:59.500249 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-97f70192-4315-41b8-a749-bfbb2ab0ee28 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:59:59.501452 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-97f70192-4315-41b8-a749-bfbb2ab0ee28 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984" status: 200 len: 1738 microversion: 2.20 time: 1.270364 May 26 14:59:59.508511 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 223/420] 10.222.0.81 () {60 vars in 1277 bytes} [Wed May 26 14:59:58 2021] GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984 => generated 1738 bytes in 1278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 14:59:59.513381 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-7b5f3623-6063-46ba-aae6-df0bac9ae492 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 14:59:59.517565 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-7b5f3623-6063-46ba-aae6-df0bac9ae492 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: a9d8f9a6-bd66-4caa-8662-4bb94655ae59] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 14:59:59.534999 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-7b5f3623-6063-46ba-aae6-df0bac9ae492 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:59.540303 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-7b5f3623-6063-46ba-aae6-df0bac9ae492 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:59.543619 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-7b5f3623-6063-46ba-aae6-df0bac9ae492 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:59.544313 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-7b5f3623-6063-46ba-aae6-df0bac9ae492 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:59.891720 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-771eef87-b22c-49e9-9f03-c477559ba77c tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96610ea2bcf84875be6d08859dd0c7b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dffd269c3a344d36b77ebb04d0c412e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 14:59:59.907207 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-771eef87-b22c-49e9-9f03-c477559ba77c tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] 10.222.0.81 "GET /compute/v2.1/servers/017ce180-3d28-4cea-8c40-c113c3627273" status: 200 len: 1314 microversion: 2.1 time: 0.649960 May 26 14:59:59.926624 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 198/421] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:59:59 2021] GET /compute/v2.1/servers/017ce180-3d28-4cea-8c40-c113c3627273 => generated 1314 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 14:59:59.926624 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [req-fc394072-a20f-4499-b9c8-d9d7fc7fc5eb req-57853fb8-46ad-46f5-8eae-daf9f85b2a5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "598b0e3f-8cf1-451a-80a8-ed7e5dd36984", "name": "network-vif-plugged", "status": "completed", "tag": "e948d481-711f-45b8-8deb-08b7658709e7"}]} {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 14:59:59.932183 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 14:59:59.932183 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: warnings.warn(msg) May 26 14:59:59.955565 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [req-fc394072-a20f-4499-b9c8-d9d7fc7fc5eb req-57853fb8-46ad-46f5-8eae-daf9f85b2a5d service nova] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 14:59:59.956022 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [req-fc394072-a20f-4499-b9c8-d9d7fc7fc5eb req-57853fb8-46ad-46f5-8eae-daf9f85b2a5d service nova] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 14:59:59.988797 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.compute.server_external_events [req-fc394072-a20f-4499-b9c8-d9d7fc7fc5eb req-57853fb8-46ad-46f5-8eae-daf9f85b2a5d service nova] Creating event network-vif-plugged:e948d481-711f-45b8-8deb-08b7658709e7 for instance 598b0e3f-8cf1-451a-80a8-ed7e5dd36984 on hv-cinder-78414 May 26 14:59:59.994736 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [req-fc394072-a20f-4499-b9c8-d9d7fc7fc5eb req-57853fb8-46ad-46f5-8eae-daf9f85b2a5d service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084090 May 26 14:59:59.995986 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 199/422] 10.222.0.81 () {64 vars in 1318 bytes} [Wed May 26 14:59:59 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:00:00.006805 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-74d7f320-f504-408b-9fe1-e56ee5b80c07 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:00.008157 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-74d7f320-f504-408b-9fe1-e56ee5b80c07 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] [instance: f4f8081b-28f4-4e9f-bf48-471d84e67da8] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:00.018540 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-74d7f320-f504-408b-9fe1-e56ee5b80c07 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:00.024478 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-74d7f320-f504-408b-9fe1-e56ee5b80c07 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:00.025813 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-74d7f320-f504-408b-9fe1-e56ee5b80c07 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:00.026687 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-74d7f320-f504-408b-9fe1-e56ee5b80c07 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:00.325246 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-74d7f320-f504-408b-9fe1-e56ee5b80c07 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be4bd5c0f2a400da491bae101b48832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515325707f64d58a28f26451b2c74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:00.335368 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-74d7f320-f504-408b-9fe1-e56ee5b80c07 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /compute/v2.1/servers/f4f8081b-28f4-4e9f-bf48-471d84e67da8" status: 200 len: 1317 microversion: 2.1 time: 0.337968 May 26 15:00:00.345039 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 200/423] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:59:59 2021] GET /compute/v2.1/servers/f4f8081b-28f4-4e9f-bf48-471d84e67da8 => generated 1317 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:00:00.355206 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-f3732777-efe0-47bd-8251-10e805be16ff tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:00.355847 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-f3732777-efe0-47bd-8251-10e805be16ff tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] [instance: aa145a33-41b1-4e39-9642-132aca11fcfe] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:00.379781 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-f3732777-efe0-47bd-8251-10e805be16ff tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:00.380635 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-f3732777-efe0-47bd-8251-10e805be16ff tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:00.381841 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-f3732777-efe0-47bd-8251-10e805be16ff tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:00.382501 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-f3732777-efe0-47bd-8251-10e805be16ff tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:00.473454 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-7b5f3623-6063-46ba-aae6-df0bac9ae492 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c2fb208b56d4d52b59ac09873f16180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e8cac36a174b2eb5a6e53fdf25b4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:00.485575 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-7b5f3623-6063-46ba-aae6-df0bac9ae492 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59" status: 200 len: 1723 microversion: 2.1 time: 0.975608 May 26 15:00:00.487417 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 224/424] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 14:59:59 2021] GET /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59 => generated 1723 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:00:00.531244 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-76b8cde7-0e85-4b41-a587-a78ede687857 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:00.532284 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-76b8cde7-0e85-4b41-a587-a78ede687857 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 598b0e3f-8cf1-451a-80a8-ed7e5dd36984] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:00.542573 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-76b8cde7-0e85-4b41-a587-a78ede687857 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:00.543446 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-76b8cde7-0e85-4b41-a587-a78ede687857 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:00.544612 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-76b8cde7-0e85-4b41-a587-a78ede687857 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:00.545057 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-76b8cde7-0e85-4b41-a587-a78ede687857 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:00.665271 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-f3732777-efe0-47bd-8251-10e805be16ff tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b167942c895345b186a3eda5c82175b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad2ab2705ca479ab4aaafe7c80de162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:00.684941 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-f3732777-efe0-47bd-8251-10e805be16ff tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /compute/v2.1/servers/aa145a33-41b1-4e39-9642-132aca11fcfe" status: 200 len: 1567 microversion: 2.1 time: 0.337276 May 26 15:00:00.687558 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 201/425] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:00:00 2021] GET /compute/v2.1/servers/aa145a33-41b1-4e39-9642-132aca11fcfe => generated 1567 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:00:00.950544 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-46e58981-4c55-4bc8-b25c-82f1d9bcb5d5 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:00.951163 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-46e58981-4c55-4bc8-b25c-82f1d9bcb5d5 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] [instance: 017ce180-3d28-4cea-8c40-c113c3627273] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:00.964146 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-46e58981-4c55-4bc8-b25c-82f1d9bcb5d5 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:00.966067 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-46e58981-4c55-4bc8-b25c-82f1d9bcb5d5 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:00.969424 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-46e58981-4c55-4bc8-b25c-82f1d9bcb5d5 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:00.969987 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-46e58981-4c55-4bc8-b25c-82f1d9bcb5d5 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:01.002097 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-76b8cde7-0e85-4b41-a587-a78ede687857 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:01.014599 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-76b8cde7-0e85-4b41-a587-a78ede687857 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:01.016115 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-76b8cde7-0e85-4b41-a587-a78ede687857 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:01.018222 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-76b8cde7-0e85-4b41-a587-a78ede687857 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984" status: 200 len: 1738 microversion: 2.20 time: 0.491259 May 26 15:00:01.018717 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 225/426] 10.222.0.81 () {60 vars in 1277 bytes} [Wed May 26 15:00:00 2021] GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984 => generated 1738 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 15:00:01.358636 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-46e58981-4c55-4bc8-b25c-82f1d9bcb5d5 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96610ea2bcf84875be6d08859dd0c7b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dffd269c3a344d36b77ebb04d0c412e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:01.366648 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-fe1ba21b-a58d-439c-878e-971f1d122280 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:01.369555 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-fe1ba21b-a58d-439c-878e-971f1d122280 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] [instance: f4f8081b-28f4-4e9f-bf48-471d84e67da8] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:01.385442 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-46e58981-4c55-4bc8-b25c-82f1d9bcb5d5 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] 10.222.0.81 "GET /compute/v2.1/servers/017ce180-3d28-4cea-8c40-c113c3627273" status: 200 len: 1314 microversion: 2.1 time: 0.438833 May 26 15:00:01.391005 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 202/427] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:00:00 2021] GET /compute/v2.1/servers/017ce180-3d28-4cea-8c40-c113c3627273 => generated 1314 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:00:01.394151 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-fe1ba21b-a58d-439c-878e-971f1d122280 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:01.396771 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-fe1ba21b-a58d-439c-878e-971f1d122280 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:01.396990 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-fe1ba21b-a58d-439c-878e-971f1d122280 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:01.397442 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-fe1ba21b-a58d-439c-878e-971f1d122280 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:01.472047 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-ce990cb8-8212-42d0-8e9b-55955c9d92e0 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "155cc33a-6799-4058-b13c-998fa5a78ec1", "device": "/dev/sdb"}} {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:00:01.473873 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-ce990cb8-8212-42d0-8e9b-55955c9d92e0 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] [instance: 990431e1-82cb-42b0-a288-949d79e21762] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:01.496660 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-ce990cb8-8212-42d0-8e9b-55955c9d92e0 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:01.499100 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-ce990cb8-8212-42d0-8e9b-55955c9d92e0 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:01.500226 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-ce990cb8-8212-42d0-8e9b-55955c9d92e0 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:01.500687 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-ce990cb8-8212-42d0-8e9b-55955c9d92e0 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:01.919641 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-fe1ba21b-a58d-439c-878e-971f1d122280 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be4bd5c0f2a400da491bae101b48832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515325707f64d58a28f26451b2c74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:01.939632 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-fe1ba21b-a58d-439c-878e-971f1d122280 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /compute/v2.1/servers/f4f8081b-28f4-4e9f-bf48-471d84e67da8" status: 200 len: 1317 microversion: 2.1 time: 0.590391 May 26 15:00:01.949149 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 226/428] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:00:01 2021] GET /compute/v2.1/servers/f4f8081b-28f4-4e9f-bf48-471d84e67da8 => generated 1317 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:00:01.949149 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-1b95194b-63d9-4ec2-860f-926ef48a7137 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:01.949149 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-1b95194b-63d9-4ec2-860f-926ef48a7137 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: a9d8f9a6-bd66-4caa-8662-4bb94655ae59] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:01.958533 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-1b95194b-63d9-4ec2-860f-926ef48a7137 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:01.961636 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-1b95194b-63d9-4ec2-860f-926ef48a7137 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:01.961636 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-1b95194b-63d9-4ec2-860f-926ef48a7137 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:01.961636 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-1b95194b-63d9-4ec2-860f-926ef48a7137 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:02.446103 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-1b95194b-63d9-4ec2-860f-926ef48a7137 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c2fb208b56d4d52b59ac09873f16180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e8cac36a174b2eb5a6e53fdf25b4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:02.476400 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-1b95194b-63d9-4ec2-860f-926ef48a7137 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59" status: 200 len: 1723 microversion: 2.1 time: 0.534496 May 26 15:00:02.478281 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 227/429] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:00:01 2021] GET /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59 => generated 1723 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:00:02.483160 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-2d80c114-7ddc-4ca8-8465-f1f93a80945c tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:02.486914 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-2d80c114-7ddc-4ca8-8465-f1f93a80945c tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] [instance: aa145a33-41b1-4e39-9642-132aca11fcfe] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:02.492526 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-2d80c114-7ddc-4ca8-8465-f1f93a80945c tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:02.493220 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-2d80c114-7ddc-4ca8-8465-f1f93a80945c tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:02.494036 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-2d80c114-7ddc-4ca8-8465-f1f93a80945c tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:02.494476 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-2d80c114-7ddc-4ca8-8465-f1f93a80945c tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:02.826809 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-ce990cb8-8212-42d0-8e9b-55955c9d92e0 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] 10.222.0.81 "POST /compute/v2.1/servers/990431e1-82cb-42b0-a288-949d79e21762/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.359862 May 26 15:00:02.830258 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 203/430] 10.222.0.81 () {60 vars in 1323 bytes} [Wed May 26 15:00:01 2021] POST /compute/v2.1/servers/990431e1-82cb-42b0-a288-949d79e21762/os-volume_attachments => generated 194 bytes in 1364 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:00:02.838523 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [req-01ee622b-b08a-4150-b19d-10409bc7a065 req-3e0e4e73-cb66-423c-a1b1-6008ff0bc6bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4f8081b-28f4-4e9f-bf48-471d84e67da8", "name": "network-vif-plugged", "status": "completed", "tag": "3ab2e391-3d42-467d-8e80-fe132717746c"}]} {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:00:02.841412 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 15:00:02.841412 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: warnings.warn(msg) May 26 15:00:02.866504 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [req-01ee622b-b08a-4150-b19d-10409bc7a065 req-3e0e4e73-cb66-423c-a1b1-6008ff0bc6bf service nova] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:02.867350 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [req-01ee622b-b08a-4150-b19d-10409bc7a065 req-3e0e4e73-cb66-423c-a1b1-6008ff0bc6bf service nova] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:02.888962 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.compute.server_external_events [req-01ee622b-b08a-4150-b19d-10409bc7a065 req-3e0e4e73-cb66-423c-a1b1-6008ff0bc6bf service nova] Creating event network-vif-plugged:3ab2e391-3d42-467d-8e80-fe132717746c for instance f4f8081b-28f4-4e9f-bf48-471d84e67da8 on hv-cinder-78414 May 26 15:00:02.909743 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [req-01ee622b-b08a-4150-b19d-10409bc7a065 req-3e0e4e73-cb66-423c-a1b1-6008ff0bc6bf service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067332 May 26 15:00:02.909743 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 204/431] 10.222.0.81 () {64 vars in 1318 bytes} [Wed May 26 15:00:02 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:00:02.909743 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-86ad0f39-2cb0-48f7-8934-411599a7acc0 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:02.909743 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-86ad0f39-2cb0-48f7-8934-411599a7acc0 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 598b0e3f-8cf1-451a-80a8-ed7e5dd36984] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:02.948443 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-86ad0f39-2cb0-48f7-8934-411599a7acc0 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:02.949056 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-86ad0f39-2cb0-48f7-8934-411599a7acc0 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:02.951018 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-86ad0f39-2cb0-48f7-8934-411599a7acc0 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:02.951018 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-86ad0f39-2cb0-48f7-8934-411599a7acc0 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:03.116504 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-2d80c114-7ddc-4ca8-8465-f1f93a80945c tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b167942c895345b186a3eda5c82175b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad2ab2705ca479ab4aaafe7c80de162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:03.128432 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-2d80c114-7ddc-4ca8-8465-f1f93a80945c tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /compute/v2.1/servers/aa145a33-41b1-4e39-9642-132aca11fcfe" status: 200 len: 1567 microversion: 2.1 time: 0.648829 May 26 15:00:03.129020 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 228/432] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:00:02 2021] GET /compute/v2.1/servers/aa145a33-41b1-4e39-9642-132aca11fcfe => generated 1567 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:00:03.157923 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-014d4854-1925-4f45-8f61-b104a21203b4 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:03.157923 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-014d4854-1925-4f45-8f61-b104a21203b4 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] [instance: 017ce180-3d28-4cea-8c40-c113c3627273] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:03.177451 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-014d4854-1925-4f45-8f61-b104a21203b4 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:03.177979 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-014d4854-1925-4f45-8f61-b104a21203b4 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:03.178783 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-014d4854-1925-4f45-8f61-b104a21203b4 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:03.179232 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-014d4854-1925-4f45-8f61-b104a21203b4 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:03.396611 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-86ad0f39-2cb0-48f7-8934-411599a7acc0 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:03.413880 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-86ad0f39-2cb0-48f7-8934-411599a7acc0 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:03.418359 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-86ad0f39-2cb0-48f7-8934-411599a7acc0 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:03.422231 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-86ad0f39-2cb0-48f7-8934-411599a7acc0 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984" status: 200 len: 1738 microversion: 2.20 time: 0.520105 May 26 15:00:03.425414 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 205/433] 10.222.0.81 () {60 vars in 1277 bytes} [Wed May 26 15:00:02 2021] GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984 => generated 1738 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:00:03.448988 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-6c6daee5-f7fe-4b75-ba96-5e450d993754 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:03.450726 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-6c6daee5-f7fe-4b75-ba96-5e450d993754 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] [instance: f4f8081b-28f4-4e9f-bf48-471d84e67da8] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:03.470189 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-6c6daee5-f7fe-4b75-ba96-5e450d993754 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:03.473856 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-6c6daee5-f7fe-4b75-ba96-5e450d993754 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:03.478067 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-6c6daee5-f7fe-4b75-ba96-5e450d993754 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:03.478067 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-6c6daee5-f7fe-4b75-ba96-5e450d993754 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:03.687613 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-014d4854-1925-4f45-8f61-b104a21203b4 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96610ea2bcf84875be6d08859dd0c7b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dffd269c3a344d36b77ebb04d0c412e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:03.701257 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-014d4854-1925-4f45-8f61-b104a21203b4 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] 10.222.0.81 "GET /compute/v2.1/servers/017ce180-3d28-4cea-8c40-c113c3627273" status: 200 len: 1314 microversion: 2.1 time: 0.558473 May 26 15:00:03.701869 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 229/434] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:00:03 2021] GET /compute/v2.1/servers/017ce180-3d28-4cea-8c40-c113c3627273 => generated 1314 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:00:03.709825 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-c11f9631-f4e9-4042-b223-7919bff613e0 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:03.710662 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-c11f9631-f4e9-4042-b223-7919bff613e0 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: a9d8f9a6-bd66-4caa-8662-4bb94655ae59] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:03.719074 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-c11f9631-f4e9-4042-b223-7919bff613e0 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:03.719800 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-c11f9631-f4e9-4042-b223-7919bff613e0 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:03.722141 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-c11f9631-f4e9-4042-b223-7919bff613e0 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:03.722825 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-c11f9631-f4e9-4042-b223-7919bff613e0 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:03.793805 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-6c6daee5-f7fe-4b75-ba96-5e450d993754 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be4bd5c0f2a400da491bae101b48832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515325707f64d58a28f26451b2c74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:03.802695 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-6c6daee5-f7fe-4b75-ba96-5e450d993754 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /compute/v2.1/servers/f4f8081b-28f4-4e9f-bf48-471d84e67da8" status: 200 len: 1317 microversion: 2.1 time: 0.375040 May 26 15:00:03.803636 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 206/435] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:00:03 2021] GET /compute/v2.1/servers/f4f8081b-28f4-4e9f-bf48-471d84e67da8 => generated 1317 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:00:04.012457 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-c11f9631-f4e9-4042-b223-7919bff613e0 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c2fb208b56d4d52b59ac09873f16180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e8cac36a174b2eb5a6e53fdf25b4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:04.038053 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-c11f9631-f4e9-4042-b223-7919bff613e0 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59" status: 200 len: 1723 microversion: 2.1 time: 0.332776 May 26 15:00:04.039181 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 230/436] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:00:03 2021] GET /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59 => generated 1723 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:00:04.147343 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-0b7089e0-8b07-4766-ad96-d2422317bc63 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:04.147978 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-0b7089e0-8b07-4766-ad96-d2422317bc63 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] [instance: aa145a33-41b1-4e39-9642-132aca11fcfe] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:04.155838 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-0b7089e0-8b07-4766-ad96-d2422317bc63 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:04.156289 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-0b7089e0-8b07-4766-ad96-d2422317bc63 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:04.157068 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-0b7089e0-8b07-4766-ad96-d2422317bc63 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:04.158162 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-0b7089e0-8b07-4766-ad96-d2422317bc63 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:04.359190 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-0b7089e0-8b07-4766-ad96-d2422317bc63 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b167942c895345b186a3eda5c82175b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad2ab2705ca479ab4aaafe7c80de162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:04.368399 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-0b7089e0-8b07-4766-ad96-d2422317bc63 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /compute/v2.1/servers/aa145a33-41b1-4e39-9642-132aca11fcfe" status: 200 len: 1567 microversion: 2.1 time: 0.224826 May 26 15:00:04.379526 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 207/437] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:00:04 2021] GET /compute/v2.1/servers/aa145a33-41b1-4e39-9642-132aca11fcfe => generated 1567 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:00:04.443922 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-ada1ce10-c94d-4af3-839a-c70b547a67c7 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:04.444707 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-ada1ce10-c94d-4af3-839a-c70b547a67c7 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 598b0e3f-8cf1-451a-80a8-ed7e5dd36984] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:04.455808 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-ada1ce10-c94d-4af3-839a-c70b547a67c7 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:04.455808 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-ada1ce10-c94d-4af3-839a-c70b547a67c7 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:04.455808 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-ada1ce10-c94d-4af3-839a-c70b547a67c7 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:04.455808 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-ada1ce10-c94d-4af3-839a-c70b547a67c7 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:04.719646 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-da16f4df-f831-404b-a26e-7a6d8124e71a tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:04.720296 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-da16f4df-f831-404b-a26e-7a6d8124e71a tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] [instance: 017ce180-3d28-4cea-8c40-c113c3627273] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:04.721611 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-ada1ce10-c94d-4af3-839a-c70b547a67c7 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:04.747770 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-da16f4df-f831-404b-a26e-7a6d8124e71a tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:04.748227 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-da16f4df-f831-404b-a26e-7a6d8124e71a tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:04.748723 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-ada1ce10-c94d-4af3-839a-c70b547a67c7 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:04.749020 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-da16f4df-f831-404b-a26e-7a6d8124e71a tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:04.749462 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-da16f4df-f831-404b-a26e-7a6d8124e71a tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:04.753074 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-ada1ce10-c94d-4af3-839a-c70b547a67c7 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:04.757596 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-ada1ce10-c94d-4af3-839a-c70b547a67c7 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984" status: 200 len: 1738 microversion: 2.20 time: 0.318766 May 26 15:00:04.776921 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 231/438] 10.222.0.81 () {60 vars in 1277 bytes} [Wed May 26 15:00:04 2021] GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984 => generated 1738 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:00:04.820418 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-90225932-269f-4052-a695-194031d20871 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:04.822479 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-90225932-269f-4052-a695-194031d20871 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] [instance: f4f8081b-28f4-4e9f-bf48-471d84e67da8] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:04.834890 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-90225932-269f-4052-a695-194031d20871 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:04.841661 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-90225932-269f-4052-a695-194031d20871 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:04.842864 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-90225932-269f-4052-a695-194031d20871 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:04.844346 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-90225932-269f-4052-a695-194031d20871 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:05.268027 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-da16f4df-f831-404b-a26e-7a6d8124e71a tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96610ea2bcf84875be6d08859dd0c7b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dffd269c3a344d36b77ebb04d0c412e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:05.289623 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-da16f4df-f831-404b-a26e-7a6d8124e71a tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] 10.222.0.81 "GET /compute/v2.1/servers/017ce180-3d28-4cea-8c40-c113c3627273" status: 200 len: 1314 microversion: 2.1 time: 0.573990 May 26 15:00:05.293128 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 208/439] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:00:04 2021] GET /compute/v2.1/servers/017ce180-3d28-4cea-8c40-c113c3627273 => generated 1314 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:00:05.306835 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-90225932-269f-4052-a695-194031d20871 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be4bd5c0f2a400da491bae101b48832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515325707f64d58a28f26451b2c74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:05.317957 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-52c31d4c-7fe2-4729-9930-937346263be7 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:05.319822 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-52c31d4c-7fe2-4729-9930-937346263be7 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: a9d8f9a6-bd66-4caa-8662-4bb94655ae59] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:05.330508 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-52c31d4c-7fe2-4729-9930-937346263be7 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:05.331234 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-52c31d4c-7fe2-4729-9930-937346263be7 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:05.332264 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-52c31d4c-7fe2-4729-9930-937346263be7 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:05.333045 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-52c31d4c-7fe2-4729-9930-937346263be7 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:05.341370 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-90225932-269f-4052-a695-194031d20871 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /compute/v2.1/servers/f4f8081b-28f4-4e9f-bf48-471d84e67da8" status: 200 len: 1317 microversion: 2.1 time: 0.524522 May 26 15:00:05.352192 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 232/440] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:00:04 2021] GET /compute/v2.1/servers/f4f8081b-28f4-4e9f-bf48-471d84e67da8 => generated 1317 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:00:05.387432 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-fa8b7362-cf97-4e41-9423-bada3a4d11f4 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:05.388044 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-fa8b7362-cf97-4e41-9423-bada3a4d11f4 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] [instance: aa145a33-41b1-4e39-9642-132aca11fcfe] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:05.399221 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-fa8b7362-cf97-4e41-9423-bada3a4d11f4 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:05.399682 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-fa8b7362-cf97-4e41-9423-bada3a4d11f4 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:05.400486 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-fa8b7362-cf97-4e41-9423-bada3a4d11f4 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:05.400931 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-fa8b7362-cf97-4e41-9423-bada3a4d11f4 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:05.675671 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-52c31d4c-7fe2-4729-9930-937346263be7 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c2fb208b56d4d52b59ac09873f16180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e8cac36a174b2eb5a6e53fdf25b4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:05.686246 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-52c31d4c-7fe2-4729-9930-937346263be7 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59" status: 200 len: 1723 microversion: 2.1 time: 0.391009 May 26 15:00:05.690345 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 209/441] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:00:05 2021] GET /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59 => generated 1723 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:00:05.709384 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-fa8b7362-cf97-4e41-9423-bada3a4d11f4 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b167942c895345b186a3eda5c82175b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad2ab2705ca479ab4aaafe7c80de162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:05.721113 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-fa8b7362-cf97-4e41-9423-bada3a4d11f4 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /compute/v2.1/servers/aa145a33-41b1-4e39-9642-132aca11fcfe" status: 200 len: 1567 microversion: 2.1 time: 0.336547 May 26 15:00:05.722065 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 233/442] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:00:05 2021] GET /compute/v2.1/servers/aa145a33-41b1-4e39-9642-132aca11fcfe => generated 1567 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:00:05.736093 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [req-4c83a9ff-e9a4-4e29-bd44-533de3d44952 req-4218a7a4-4ec5-416c-8200-33cdc4432569 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "017ce180-3d28-4cea-8c40-c113c3627273", "name": "network-vif-plugged", "status": "completed", "tag": "717c230d-741b-4c4f-abf3-9fd63dc119c4"}]} {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:00:05.738707 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 15:00:05.738707 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: warnings.warn(msg) May 26 15:00:05.748242 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [req-4c83a9ff-e9a4-4e29-bd44-533de3d44952 req-4218a7a4-4ec5-416c-8200-33cdc4432569 service nova] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:05.749067 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [req-4c83a9ff-e9a4-4e29-bd44-533de3d44952 req-4218a7a4-4ec5-416c-8200-33cdc4432569 service nova] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:05.779895 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-98bf742c-0ad0-457b-bbb9-5dfea64f85a2 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:05.780781 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-98bf742c-0ad0-457b-bbb9-5dfea64f85a2 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 598b0e3f-8cf1-451a-80a8-ed7e5dd36984] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:05.796347 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.compute.server_external_events [req-4c83a9ff-e9a4-4e29-bd44-533de3d44952 req-4218a7a4-4ec5-416c-8200-33cdc4432569 service nova] Creating event network-vif-plugged:717c230d-741b-4c4f-abf3-9fd63dc119c4 for instance 017ce180-3d28-4cea-8c40-c113c3627273 on hv-cinder-78414 May 26 15:00:05.800728 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-98bf742c-0ad0-457b-bbb9-5dfea64f85a2 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:05.806094 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-98bf742c-0ad0-457b-bbb9-5dfea64f85a2 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:05.807147 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-98bf742c-0ad0-457b-bbb9-5dfea64f85a2 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:05.809102 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-98bf742c-0ad0-457b-bbb9-5dfea64f85a2 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:05.819830 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [req-4c83a9ff-e9a4-4e29-bd44-533de3d44952 req-4218a7a4-4ec5-416c-8200-33cdc4432569 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087273 May 26 15:00:05.822552 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 210/443] 10.222.0.81 () {64 vars in 1318 bytes} [Wed May 26 15:00:05 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:00:06.309971 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-8573768a-584e-4601-88e0-2547c2bea45a tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:06.310663 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-8573768a-584e-4601-88e0-2547c2bea45a tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] [instance: 017ce180-3d28-4cea-8c40-c113c3627273] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:06.327432 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-8573768a-584e-4601-88e0-2547c2bea45a tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:06.328190 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-8573768a-584e-4601-88e0-2547c2bea45a tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:06.329177 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-8573768a-584e-4601-88e0-2547c2bea45a tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:06.329847 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-8573768a-584e-4601-88e0-2547c2bea45a tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:06.426077 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-98bf742c-0ad0-457b-bbb9-5dfea64f85a2 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:06.446687 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-98bf742c-0ad0-457b-bbb9-5dfea64f85a2 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:06.448100 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-98bf742c-0ad0-457b-bbb9-5dfea64f85a2 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:06.449274 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-98bf742c-0ad0-457b-bbb9-5dfea64f85a2 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984" status: 200 len: 1738 microversion: 2.20 time: 0.674008 May 26 15:00:06.486605 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 234/444] 10.222.0.81 () {60 vars in 1277 bytes} [Wed May 26 15:00:05 2021] GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984 => generated 1738 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 15:00:06.491095 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-b6d3c687-9a4f-4412-89c4-59563e84fb0a tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:06.491722 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-b6d3c687-9a4f-4412-89c4-59563e84fb0a tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] [instance: f4f8081b-28f4-4e9f-bf48-471d84e67da8] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:06.499300 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-b6d3c687-9a4f-4412-89c4-59563e84fb0a tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:06.499773 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-b6d3c687-9a4f-4412-89c4-59563e84fb0a tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:06.500572 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-b6d3c687-9a4f-4412-89c4-59563e84fb0a tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:06.501028 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-b6d3c687-9a4f-4412-89c4-59563e84fb0a tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:06.757120 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-8573768a-584e-4601-88e0-2547c2bea45a tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96610ea2bcf84875be6d08859dd0c7b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dffd269c3a344d36b77ebb04d0c412e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:06.769012 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-8573768a-584e-4601-88e0-2547c2bea45a tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] 10.222.0.81 "GET /compute/v2.1/servers/017ce180-3d28-4cea-8c40-c113c3627273" status: 200 len: 1314 microversion: 2.1 time: 0.463216 May 26 15:00:06.782934 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 211/445] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:00:06 2021] GET /compute/v2.1/servers/017ce180-3d28-4cea-8c40-c113c3627273 => generated 1314 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:00:06.788093 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-6cdf7b7f-5eb0-4e66-b9d5-a504bff795f6 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:06.789082 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-6cdf7b7f-5eb0-4e66-b9d5-a504bff795f6 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: a9d8f9a6-bd66-4caa-8662-4bb94655ae59] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:06.803120 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-6cdf7b7f-5eb0-4e66-b9d5-a504bff795f6 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:06.803947 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-6cdf7b7f-5eb0-4e66-b9d5-a504bff795f6 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:06.805057 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-6cdf7b7f-5eb0-4e66-b9d5-a504bff795f6 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:06.805794 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-6cdf7b7f-5eb0-4e66-b9d5-a504bff795f6 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:07.015828 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-b6d3c687-9a4f-4412-89c4-59563e84fb0a tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be4bd5c0f2a400da491bae101b48832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515325707f64d58a28f26451b2c74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:07.052059 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-b6d3c687-9a4f-4412-89c4-59563e84fb0a tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /compute/v2.1/servers/f4f8081b-28f4-4e9f-bf48-471d84e67da8" status: 200 len: 1508 microversion: 2.1 time: 0.564432 May 26 15:00:07.066112 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 235/446] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:00:06 2021] GET /compute/v2.1/servers/f4f8081b-28f4-4e9f-bf48-471d84e67da8 => generated 1508 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:00:07.071879 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-7e1abba5-8173-4ba6-8ab7-3ae2352c1464 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:07.072713 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-7e1abba5-8173-4ba6-8ab7-3ae2352c1464 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] [instance: aa145a33-41b1-4e39-9642-132aca11fcfe] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:07.082539 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-7e1abba5-8173-4ba6-8ab7-3ae2352c1464 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:07.083242 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-7e1abba5-8173-4ba6-8ab7-3ae2352c1464 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:07.084224 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-7e1abba5-8173-4ba6-8ab7-3ae2352c1464 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:07.084823 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-7e1abba5-8173-4ba6-8ab7-3ae2352c1464 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:07.171929 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-6cdf7b7f-5eb0-4e66-b9d5-a504bff795f6 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c2fb208b56d4d52b59ac09873f16180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e8cac36a174b2eb5a6e53fdf25b4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:07.184115 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-6cdf7b7f-5eb0-4e66-b9d5-a504bff795f6 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59" status: 200 len: 1700 microversion: 2.1 time: 0.399694 May 26 15:00:07.185359 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 212/447] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:00:06 2021] GET /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59 => generated 1700 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:00:07.209059 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-333ae7aa-e600-46fe-aa80-ccdf55b88c10 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:00:07.217155 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-333ae7aa-e600-46fe-aa80-ccdf55b88c10 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:07.217932 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-333ae7aa-e600-46fe-aa80-ccdf55b88c10 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:07.308678 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-333ae7aa-e600-46fe-aa80-ccdf55b88c10 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: a9d8f9a6-bd66-4caa-8662-4bb94655ae59] Going to try to start instance {{(pid=118514) start /opt/stack/nova/nova/compute/api.py:2602}} May 26 15:00:07.451629 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-7e1abba5-8173-4ba6-8ab7-3ae2352c1464 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b167942c895345b186a3eda5c82175b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad2ab2705ca479ab4aaafe7c80de162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:07.465784 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-7e1abba5-8173-4ba6-8ab7-3ae2352c1464 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /compute/v2.1/servers/aa145a33-41b1-4e39-9642-132aca11fcfe" status: 200 len: 1567 microversion: 2.1 time: 0.396502 May 26 15:00:07.468923 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 236/448] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:00:07 2021] GET /compute/v2.1/servers/aa145a33-41b1-4e39-9642-132aca11fcfe => generated 1567 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:00:07.484066 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-a49883b3-bfa3-47e6-b0df-d23040b5b3d0 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:07.487208 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-a49883b3-bfa3-47e6-b0df-d23040b5b3d0 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 598b0e3f-8cf1-451a-80a8-ed7e5dd36984] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:07.511435 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-a49883b3-bfa3-47e6-b0df-d23040b5b3d0 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:07.524428 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-a49883b3-bfa3-47e6-b0df-d23040b5b3d0 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:07.526449 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-a49883b3-bfa3-47e6-b0df-d23040b5b3d0 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:07.530215 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-a49883b3-bfa3-47e6-b0df-d23040b5b3d0 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:07.606144 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-333ae7aa-e600-46fe-aa80-ccdf55b88c10 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "POST /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59/action" status: 202 len: 0 microversion: 2.1 time: 0.407856 May 26 15:00:07.606877 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 213/449] 10.222.0.81 () {60 vars in 1278 bytes} [Wed May 26 15:00:07 2021] POST /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59/action => generated 0 bytes in 410 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 15:00:07.632688 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-6b2c499e-b45b-48ec-84b5-f4bbfdf3668d tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:07.637610 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-6b2c499e-b45b-48ec-84b5-f4bbfdf3668d tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: a9d8f9a6-bd66-4caa-8662-4bb94655ae59] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:07.653508 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-6b2c499e-b45b-48ec-84b5-f4bbfdf3668d tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:07.657583 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-6b2c499e-b45b-48ec-84b5-f4bbfdf3668d tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:07.659343 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-6b2c499e-b45b-48ec-84b5-f4bbfdf3668d tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:07.661374 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-6b2c499e-b45b-48ec-84b5-f4bbfdf3668d tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:07.974748 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-6b2c499e-b45b-48ec-84b5-f4bbfdf3668d tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c2fb208b56d4d52b59ac09873f16180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e8cac36a174b2eb5a6e53fdf25b4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:07.987363 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-6b2c499e-b45b-48ec-84b5-f4bbfdf3668d tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59" status: 200 len: 1709 microversion: 2.1 time: 0.375116 May 26 15:00:07.988565 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 214/450] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:00:07 2021] GET /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59 => generated 1709 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:00:08.007838 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-db05d7e6-f3bf-404f-9cb1-607a41af46b7 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:08.008861 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-db05d7e6-f3bf-404f-9cb1-607a41af46b7 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] [instance: 017ce180-3d28-4cea-8c40-c113c3627273] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:08.052705 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-db05d7e6-f3bf-404f-9cb1-607a41af46b7 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:08.057360 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-db05d7e6-f3bf-404f-9cb1-607a41af46b7 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:08.058999 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-db05d7e6-f3bf-404f-9cb1-607a41af46b7 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:08.062101 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-db05d7e6-f3bf-404f-9cb1-607a41af46b7 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:08.422910 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-db05d7e6-f3bf-404f-9cb1-607a41af46b7 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96610ea2bcf84875be6d08859dd0c7b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dffd269c3a344d36b77ebb04d0c412e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:08.424275 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-a49883b3-bfa3-47e6-b0df-d23040b5b3d0 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:08.433509 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-db05d7e6-f3bf-404f-9cb1-607a41af46b7 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] 10.222.0.81 "GET /compute/v2.1/servers/017ce180-3d28-4cea-8c40-c113c3627273" status: 200 len: 1314 microversion: 2.1 time: 0.443534 May 26 15:00:08.434665 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 215/451] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:00:07 2021] GET /compute/v2.1/servers/017ce180-3d28-4cea-8c40-c113c3627273 => generated 1314 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:00:08.440089 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-a49883b3-bfa3-47e6-b0df-d23040b5b3d0 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:08.440512 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-a49883b3-bfa3-47e6-b0df-d23040b5b3d0 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:08.442015 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-a49883b3-bfa3-47e6-b0df-d23040b5b3d0 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984" status: 200 len: 1738 microversion: 2.20 time: 0.962891 May 26 15:00:08.469211 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 237/452] 10.222.0.81 () {60 vars in 1277 bytes} [Wed May 26 15:00:07 2021] GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984 => generated 1738 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:00:08.486005 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-13ccbde2-5e10-428c-b2b6-089691d4402e tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:08.491900 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-13ccbde2-5e10-428c-b2b6-089691d4402e tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] [instance: aa145a33-41b1-4e39-9642-132aca11fcfe] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:08.501914 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-13ccbde2-5e10-428c-b2b6-089691d4402e tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:08.503762 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-13ccbde2-5e10-428c-b2b6-089691d4402e tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:08.505043 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-13ccbde2-5e10-428c-b2b6-089691d4402e tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:08.505991 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-13ccbde2-5e10-428c-b2b6-089691d4402e tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:08.801126 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-13ccbde2-5e10-428c-b2b6-089691d4402e tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b167942c895345b186a3eda5c82175b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad2ab2705ca479ab4aaafe7c80de162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:08.817029 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-13ccbde2-5e10-428c-b2b6-089691d4402e tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /compute/v2.1/servers/aa145a33-41b1-4e39-9642-132aca11fcfe" status: 200 len: 1567 microversion: 2.1 time: 0.335395 May 26 15:00:08.817671 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 216/453] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:00:08 2021] GET /compute/v2.1/servers/aa145a33-41b1-4e39-9642-132aca11fcfe => generated 1567 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:00:09.004803 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-aa0630f9-25a4-40ae-80f8-f10447892ff8 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:09.005730 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-aa0630f9-25a4-40ae-80f8-f10447892ff8 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: a9d8f9a6-bd66-4caa-8662-4bb94655ae59] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:09.019842 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-aa0630f9-25a4-40ae-80f8-f10447892ff8 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:09.020302 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-aa0630f9-25a4-40ae-80f8-f10447892ff8 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:09.026809 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-aa0630f9-25a4-40ae-80f8-f10447892ff8 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:09.027696 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-aa0630f9-25a4-40ae-80f8-f10447892ff8 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:09.269161 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-4ebcffb8-da49-489b-bcd0-4a31cc72bd31 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1dce5df3-d467-45fd-bc36-b94bffe4e697"}} {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:00:09.270326 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-4ebcffb8-da49-489b-bcd0-4a31cc72bd31 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] [instance: f4f8081b-28f4-4e9f-bf48-471d84e67da8] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:09.281100 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-4ebcffb8-da49-489b-bcd0-4a31cc72bd31 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:09.281616 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-4ebcffb8-da49-489b-bcd0-4a31cc72bd31 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:09.285406 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-4ebcffb8-da49-489b-bcd0-4a31cc72bd31 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:09.285406 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-4ebcffb8-da49-489b-bcd0-4a31cc72bd31 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:09.762315 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-aa0630f9-25a4-40ae-80f8-f10447892ff8 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c2fb208b56d4d52b59ac09873f16180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e8cac36a174b2eb5a6e53fdf25b4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:09.774620 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-aa0630f9-25a4-40ae-80f8-f10447892ff8 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59" status: 200 len: 1709 microversion: 2.1 time: 0.774012 May 26 15:00:09.775870 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 238/454] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:00:08 2021] GET /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59 => generated 1709 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:00:09.787803 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-7a817d2f-9de7-4c09-92d8-fb56bae6dbab tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:09.788776 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-7a817d2f-9de7-4c09-92d8-fb56bae6dbab tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] [instance: 017ce180-3d28-4cea-8c40-c113c3627273] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:09.810413 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-7a817d2f-9de7-4c09-92d8-fb56bae6dbab tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:09.810413 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-7a817d2f-9de7-4c09-92d8-fb56bae6dbab tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:09.810413 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-7a817d2f-9de7-4c09-92d8-fb56bae6dbab tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:09.810413 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-7a817d2f-9de7-4c09-92d8-fb56bae6dbab tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:10.198064 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-7a817d2f-9de7-4c09-92d8-fb56bae6dbab tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96610ea2bcf84875be6d08859dd0c7b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dffd269c3a344d36b77ebb04d0c412e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:10.207049 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-7a817d2f-9de7-4c09-92d8-fb56bae6dbab tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] 10.222.0.81 "GET /compute/v2.1/servers/017ce180-3d28-4cea-8c40-c113c3627273" status: 200 len: 1498 microversion: 2.1 time: 0.429579 May 26 15:00:10.209956 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 239/455] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:00:09 2021] GET /compute/v2.1/servers/017ce180-3d28-4cea-8c40-c113c3627273 => generated 1498 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:00:10.212065 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-29a60201-b851-4720-b22f-fa077c6f865c tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:10.212656 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-29a60201-b851-4720-b22f-fa077c6f865c tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 598b0e3f-8cf1-451a-80a8-ed7e5dd36984] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:10.222392 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-29a60201-b851-4720-b22f-fa077c6f865c tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:10.223220 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-29a60201-b851-4720-b22f-fa077c6f865c tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:10.224610 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-29a60201-b851-4720-b22f-fa077c6f865c tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:10.226116 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-29a60201-b851-4720-b22f-fa077c6f865c tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:10.492381 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-29a60201-b851-4720-b22f-fa077c6f865c tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:10.520088 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-29a60201-b851-4720-b22f-fa077c6f865c tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:10.526651 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-29a60201-b851-4720-b22f-fa077c6f865c tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:10.526651 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-29a60201-b851-4720-b22f-fa077c6f865c tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984" status: 200 len: 1738 microversion: 2.20 time: 0.314992 May 26 15:00:10.526651 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 240/456] 10.222.0.81 () {60 vars in 1277 bytes} [Wed May 26 15:00:10 2021] GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984 => generated 1738 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:00:10.531840 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-c6f50a4e-9bcd-47fe-ad49-db783c9aa5f0 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:10.533133 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-c6f50a4e-9bcd-47fe-ad49-db783c9aa5f0 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] [instance: aa145a33-41b1-4e39-9642-132aca11fcfe] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:10.545460 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-c6f50a4e-9bcd-47fe-ad49-db783c9aa5f0 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:10.546747 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-c6f50a4e-9bcd-47fe-ad49-db783c9aa5f0 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:10.548555 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-c6f50a4e-9bcd-47fe-ad49-db783c9aa5f0 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:10.549362 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-c6f50a4e-9bcd-47fe-ad49-db783c9aa5f0 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:10.942022 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-4ebcffb8-da49-489b-bcd0-4a31cc72bd31 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "POST /compute/v2.1/servers/f4f8081b-28f4-4e9f-bf48-471d84e67da8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.673021 May 26 15:00:10.942022 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 217/457] 10.222.0.81 () {60 vars in 1323 bytes} [Wed May 26 15:00:09 2021] POST /compute/v2.1/servers/f4f8081b-28f4-4e9f-bf48-471d84e67da8/os-volume_attachments => generated 194 bytes in 1675 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:00:10.961393 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-6a3ed84e-c1cd-4b8b-89f3-41fe5f2126ea tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:10.967686 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-6a3ed84e-c1cd-4b8b-89f3-41fe5f2126ea tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: a9d8f9a6-bd66-4caa-8662-4bb94655ae59] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:11.011635 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-6a3ed84e-c1cd-4b8b-89f3-41fe5f2126ea tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:11.012407 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-6a3ed84e-c1cd-4b8b-89f3-41fe5f2126ea tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:11.014479 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-6a3ed84e-c1cd-4b8b-89f3-41fe5f2126ea tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:11.015374 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-6a3ed84e-c1cd-4b8b-89f3-41fe5f2126ea tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:11.180148 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-c6f50a4e-9bcd-47fe-ad49-db783c9aa5f0 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b167942c895345b186a3eda5c82175b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad2ab2705ca479ab4aaafe7c80de162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:11.195160 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-c6f50a4e-9bcd-47fe-ad49-db783c9aa5f0 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /compute/v2.1/servers/aa145a33-41b1-4e39-9642-132aca11fcfe" status: 200 len: 1567 microversion: 2.1 time: 0.669356 May 26 15:00:11.198398 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 241/458] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:00:10 2021] GET /compute/v2.1/servers/aa145a33-41b1-4e39-9642-132aca11fcfe => generated 1567 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:00:11.475239 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-6a3ed84e-c1cd-4b8b-89f3-41fe5f2126ea tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c2fb208b56d4d52b59ac09873f16180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e8cac36a174b2eb5a6e53fdf25b4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:11.492181 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-6a3ed84e-c1cd-4b8b-89f3-41fe5f2126ea tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59" status: 200 len: 1713 microversion: 2.1 time: 0.548301 May 26 15:00:11.506877 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 218/459] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:00:10 2021] GET /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59 => generated 1713 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:00:11.546045 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-1f9e35ed-6718-4bdc-8d9f-973826f1c190 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:11.546851 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-1f9e35ed-6718-4bdc-8d9f-973826f1c190 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 598b0e3f-8cf1-451a-80a8-ed7e5dd36984] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:11.558713 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-1f9e35ed-6718-4bdc-8d9f-973826f1c190 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:11.559402 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-1f9e35ed-6718-4bdc-8d9f-973826f1c190 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:11.560356 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-1f9e35ed-6718-4bdc-8d9f-973826f1c190 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:11.561350 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-1f9e35ed-6718-4bdc-8d9f-973826f1c190 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:11.909264 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-1f9e35ed-6718-4bdc-8d9f-973826f1c190 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:11.931357 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-1f9e35ed-6718-4bdc-8d9f-973826f1c190 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:11.936508 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-1f9e35ed-6718-4bdc-8d9f-973826f1c190 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:11.953890 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-1f9e35ed-6718-4bdc-8d9f-973826f1c190 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984" status: 200 len: 1738 microversion: 2.20 time: 0.396534 May 26 15:00:11.966022 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 242/460] 10.222.0.81 () {60 vars in 1277 bytes} [Wed May 26 15:00:11 2021] GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984 => generated 1738 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:00:12.083059 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-78958054-db4b-405b-a86e-fa483b77d70d tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:12.083597 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-78958054-db4b-405b-a86e-fa483b77d70d tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] [instance: 017ce180-3d28-4cea-8c40-c113c3627273] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:12.125063 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-78958054-db4b-405b-a86e-fa483b77d70d tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:12.125528 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-78958054-db4b-405b-a86e-fa483b77d70d tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:12.127119 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-78958054-db4b-405b-a86e-fa483b77d70d tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:12.127572 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-78958054-db4b-405b-a86e-fa483b77d70d tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:12.214874 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-78958054-db4b-405b-a86e-fa483b77d70d tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] [instance: 017ce180-3d28-4cea-8c40-c113c3627273] Going to try to terminate instance {{(pid=118514) delete /opt/stack/nova/nova/compute/api.py:2539}} May 26 15:00:12.215438 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-b0031368-6bda-4554-b837-d9d3aee94cef tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:12.216190 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-b0031368-6bda-4554-b837-d9d3aee94cef tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] [instance: aa145a33-41b1-4e39-9642-132aca11fcfe] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:12.233331 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-b0031368-6bda-4554-b837-d9d3aee94cef tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:12.234170 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-b0031368-6bda-4554-b837-d9d3aee94cef tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:12.237788 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-b0031368-6bda-4554-b837-d9d3aee94cef tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:12.237788 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-b0031368-6bda-4554-b837-d9d3aee94cef tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:12.620547 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-78958054-db4b-405b-a86e-fa483b77d70d tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] 10.222.0.81 "DELETE /compute/v2.1/servers/017ce180-3d28-4cea-8c40-c113c3627273" status: 204 len: 0 microversion: 2.1 time: 0.541657 May 26 15:00:12.621922 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 219/461] 10.222.0.81 () {58 vars in 1239 bytes} [Wed May 26 15:00:12 2021] DELETE /compute/v2.1/servers/017ce180-3d28-4cea-8c40-c113c3627273 => generated 0 bytes in 544 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 15:00:12.639838 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-55b00f5c-e823-4dc2-a24e-cfa2a3ffaadb tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:12.641564 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-55b00f5c-e823-4dc2-a24e-cfa2a3ffaadb tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] [instance: 017ce180-3d28-4cea-8c40-c113c3627273] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:12.654289 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-55b00f5c-e823-4dc2-a24e-cfa2a3ffaadb tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:12.655043 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-55b00f5c-e823-4dc2-a24e-cfa2a3ffaadb tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:12.656058 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-55b00f5c-e823-4dc2-a24e-cfa2a3ffaadb tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:12.656662 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-55b00f5c-e823-4dc2-a24e-cfa2a3ffaadb tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:12.660866 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-b0031368-6bda-4554-b837-d9d3aee94cef tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b167942c895345b186a3eda5c82175b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad2ab2705ca479ab4aaafe7c80de162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:12.677895 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-b0031368-6bda-4554-b837-d9d3aee94cef tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /compute/v2.1/servers/aa145a33-41b1-4e39-9642-132aca11fcfe" status: 200 len: 1567 microversion: 2.1 time: 0.466753 May 26 15:00:12.680457 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 243/462] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:00:12 2021] GET /compute/v2.1/servers/aa145a33-41b1-4e39-9642-132aca11fcfe => generated 1567 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:00:12.983167 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-948bd759-6a9a-4a1e-8847-cc649dccc6ba tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:12.984149 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-948bd759-6a9a-4a1e-8847-cc649dccc6ba tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 598b0e3f-8cf1-451a-80a8-ed7e5dd36984] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:13.001842 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-948bd759-6a9a-4a1e-8847-cc649dccc6ba tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:13.003006 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-948bd759-6a9a-4a1e-8847-cc649dccc6ba tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:13.004284 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-948bd759-6a9a-4a1e-8847-cc649dccc6ba tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:13.006567 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-948bd759-6a9a-4a1e-8847-cc649dccc6ba tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:13.030374 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-55b00f5c-e823-4dc2-a24e-cfa2a3ffaadb tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96610ea2bcf84875be6d08859dd0c7b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dffd269c3a344d36b77ebb04d0c412e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:13.052972 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-55b00f5c-e823-4dc2-a24e-cfa2a3ffaadb tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] 10.222.0.81 "GET /compute/v2.1/servers/017ce180-3d28-4cea-8c40-c113c3627273" status: 200 len: 1504 microversion: 2.1 time: 0.417519 May 26 15:00:13.054186 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 220/463] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:00:12 2021] GET /compute/v2.1/servers/017ce180-3d28-4cea-8c40-c113c3627273 => generated 1504 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:00:13.695369 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-b8c5db77-7d9d-4ca8-910d-c81e59ced66a tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:13.697388 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-b8c5db77-7d9d-4ca8-910d-c81e59ced66a tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] [instance: aa145a33-41b1-4e39-9642-132aca11fcfe] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:13.716305 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-948bd759-6a9a-4a1e-8847-cc649dccc6ba tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:13.727700 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-b8c5db77-7d9d-4ca8-910d-c81e59ced66a tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:13.728170 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-b8c5db77-7d9d-4ca8-910d-c81e59ced66a tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:13.728995 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-b8c5db77-7d9d-4ca8-910d-c81e59ced66a tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:13.729442 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-b8c5db77-7d9d-4ca8-910d-c81e59ced66a tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:13.731247 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-948bd759-6a9a-4a1e-8847-cc649dccc6ba tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:13.733321 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-948bd759-6a9a-4a1e-8847-cc649dccc6ba tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:13.734765 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-948bd759-6a9a-4a1e-8847-cc649dccc6ba tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984" status: 200 len: 1738 microversion: 2.20 time: 0.755934 May 26 15:00:13.750636 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 244/464] 10.222.0.81 () {60 vars in 1277 bytes} [Wed May 26 15:00:12 2021] GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984 => generated 1738 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 15:00:14.073493 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-cc7d9480-dda2-4569-926b-02c5cb1408b0 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:14.074338 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-cc7d9480-dda2-4569-926b-02c5cb1408b0 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] [instance: 017ce180-3d28-4cea-8c40-c113c3627273] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:14.083517 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-cc7d9480-dda2-4569-926b-02c5cb1408b0 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:14.084293 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-cc7d9480-dda2-4569-926b-02c5cb1408b0 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:14.085294 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-cc7d9480-dda2-4569-926b-02c5cb1408b0 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:14.086107 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-cc7d9480-dda2-4569-926b-02c5cb1408b0 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:14.115831 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-b8c5db77-7d9d-4ca8-910d-c81e59ced66a tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b167942c895345b186a3eda5c82175b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad2ab2705ca479ab4aaafe7c80de162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:14.134066 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-b8c5db77-7d9d-4ca8-910d-c81e59ced66a tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /compute/v2.1/servers/aa145a33-41b1-4e39-9642-132aca11fcfe" status: 200 len: 1567 microversion: 2.1 time: 0.442400 May 26 15:00:14.134661 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 221/465] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:00:13 2021] GET /compute/v2.1/servers/aa145a33-41b1-4e39-9642-132aca11fcfe => generated 1567 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:00:14.469212 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-cc7d9480-dda2-4569-926b-02c5cb1408b0 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96610ea2bcf84875be6d08859dd0c7b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dffd269c3a344d36b77ebb04d0c412e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:14.480189 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-cc7d9480-dda2-4569-926b-02c5cb1408b0 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] 10.222.0.81 "GET /compute/v2.1/servers/017ce180-3d28-4cea-8c40-c113c3627273" status: 200 len: 1504 microversion: 2.1 time: 0.412454 May 26 15:00:14.494228 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 245/466] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:00:14 2021] GET /compute/v2.1/servers/017ce180-3d28-4cea-8c40-c113c3627273 => generated 1504 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:00:14.758521 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-d9e4d05b-8ccb-4cca-a6d9-eb4dd9446889 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:14.759126 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-d9e4d05b-8ccb-4cca-a6d9-eb4dd9446889 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 598b0e3f-8cf1-451a-80a8-ed7e5dd36984] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:14.773034 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-d9e4d05b-8ccb-4cca-a6d9-eb4dd9446889 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:14.778803 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-d9e4d05b-8ccb-4cca-a6d9-eb4dd9446889 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:14.779833 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-d9e4d05b-8ccb-4cca-a6d9-eb4dd9446889 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:14.780424 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-d9e4d05b-8ccb-4cca-a6d9-eb4dd9446889 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:15.159106 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-9f9cbc1c-b0ff-457c-9b56-ff9e0f105d34 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:15.161824 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-9f9cbc1c-b0ff-457c-9b56-ff9e0f105d34 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] [instance: aa145a33-41b1-4e39-9642-132aca11fcfe] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:15.171979 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-9f9cbc1c-b0ff-457c-9b56-ff9e0f105d34 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:15.172737 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-9f9cbc1c-b0ff-457c-9b56-ff9e0f105d34 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:15.173793 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-9f9cbc1c-b0ff-457c-9b56-ff9e0f105d34 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:15.174431 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-9f9cbc1c-b0ff-457c-9b56-ff9e0f105d34 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:15.522621 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-d9e4d05b-8ccb-4cca-a6d9-eb4dd9446889 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:15.537070 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-d9e4d05b-8ccb-4cca-a6d9-eb4dd9446889 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:15.537070 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-d9e4d05b-8ccb-4cca-a6d9-eb4dd9446889 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:15.537070 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-d9e4d05b-8ccb-4cca-a6d9-eb4dd9446889 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984" status: 200 len: 1738 microversion: 2.20 time: 0.781821 May 26 15:00:15.537438 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 222/467] 10.222.0.81 () {60 vars in 1277 bytes} [Wed May 26 15:00:14 2021] GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984 => generated 1738 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:00:15.540610 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-bc5e983e-2d0b-434f-a751-c7157adceac9 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:15.541231 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-bc5e983e-2d0b-434f-a751-c7157adceac9 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] [instance: 017ce180-3d28-4cea-8c40-c113c3627273] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:15.548407 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-bc5e983e-2d0b-434f-a751-c7157adceac9 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:15.548962 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-bc5e983e-2d0b-434f-a751-c7157adceac9 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:15.549787 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-bc5e983e-2d0b-434f-a751-c7157adceac9 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:15.550232 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-bc5e983e-2d0b-434f-a751-c7157adceac9 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:15.624042 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-9f9cbc1c-b0ff-457c-9b56-ff9e0f105d34 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b167942c895345b186a3eda5c82175b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad2ab2705ca479ab4aaafe7c80de162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:15.636072 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-9f9cbc1c-b0ff-457c-9b56-ff9e0f105d34 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /compute/v2.1/servers/aa145a33-41b1-4e39-9642-132aca11fcfe" status: 200 len: 1567 microversion: 2.1 time: 0.484943 May 26 15:00:15.636682 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 246/468] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:00:15 2021] GET /compute/v2.1/servers/aa145a33-41b1-4e39-9642-132aca11fcfe => generated 1567 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:00:15.982120 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-bc5e983e-2d0b-434f-a751-c7157adceac9 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96610ea2bcf84875be6d08859dd0c7b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dffd269c3a344d36b77ebb04d0c412e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:15.992155 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-bc5e983e-2d0b-434f-a751-c7157adceac9 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] 10.222.0.81 "GET /compute/v2.1/servers/017ce180-3d28-4cea-8c40-c113c3627273" status: 200 len: 1504 microversion: 2.1 time: 0.454873 May 26 15:00:15.992850 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 223/469] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:00:15 2021] GET /compute/v2.1/servers/017ce180-3d28-4cea-8c40-c113c3627273 => generated 1504 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:00:16.555563 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-058650a8-aa02-4736-9170-d15776df15de tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:16.557524 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-058650a8-aa02-4736-9170-d15776df15de tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 598b0e3f-8cf1-451a-80a8-ed7e5dd36984] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:16.570622 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-058650a8-aa02-4736-9170-d15776df15de tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:16.572291 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-058650a8-aa02-4736-9170-d15776df15de tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:16.573780 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-058650a8-aa02-4736-9170-d15776df15de tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:16.574402 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-058650a8-aa02-4736-9170-d15776df15de tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:16.654147 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-a18e3c7b-7ae5-4cf9-aa52-0e516108f04e tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:16.655106 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-a18e3c7b-7ae5-4cf9-aa52-0e516108f04e tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] [instance: aa145a33-41b1-4e39-9642-132aca11fcfe] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:16.670216 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-a18e3c7b-7ae5-4cf9-aa52-0e516108f04e tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:16.672478 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-a18e3c7b-7ae5-4cf9-aa52-0e516108f04e tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:16.674186 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-a18e3c7b-7ae5-4cf9-aa52-0e516108f04e tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:16.677798 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-a18e3c7b-7ae5-4cf9-aa52-0e516108f04e tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:16.831393 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-058650a8-aa02-4736-9170-d15776df15de tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:16.843089 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-058650a8-aa02-4736-9170-d15776df15de tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:16.844649 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-058650a8-aa02-4736-9170-d15776df15de tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:16.847425 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-058650a8-aa02-4736-9170-d15776df15de tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984" status: 200 len: 1738 microversion: 2.20 time: 0.294066 May 26 15:00:16.868224 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 247/470] 10.222.0.81 () {60 vars in 1277 bytes} [Wed May 26 15:00:16 2021] GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984 => generated 1738 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:00:17.009559 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-e4fbc365-fa8f-4a60-9ff9-3a386217d261 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:17.010320 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-e4fbc365-fa8f-4a60-9ff9-3a386217d261 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] [instance: 017ce180-3d28-4cea-8c40-c113c3627273] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:17.019296 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-e4fbc365-fa8f-4a60-9ff9-3a386217d261 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:17.019882 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-e4fbc365-fa8f-4a60-9ff9-3a386217d261 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:17.020792 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-e4fbc365-fa8f-4a60-9ff9-3a386217d261 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:17.021319 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-e4fbc365-fa8f-4a60-9ff9-3a386217d261 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:17.135492 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-a18e3c7b-7ae5-4cf9-aa52-0e516108f04e tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b167942c895345b186a3eda5c82175b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad2ab2705ca479ab4aaafe7c80de162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:17.147227 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-a18e3c7b-7ae5-4cf9-aa52-0e516108f04e tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /compute/v2.1/servers/aa145a33-41b1-4e39-9642-132aca11fcfe" status: 200 len: 1567 microversion: 2.1 time: 0.497167 May 26 15:00:17.149199 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 224/471] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:00:16 2021] GET /compute/v2.1/servers/aa145a33-41b1-4e39-9642-132aca11fcfe => generated 1567 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:00:17.256580 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-e4fbc365-fa8f-4a60-9ff9-3a386217d261 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96610ea2bcf84875be6d08859dd0c7b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dffd269c3a344d36b77ebb04d0c412e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:17.265269 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-e4fbc365-fa8f-4a60-9ff9-3a386217d261 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] 10.222.0.81 "GET /compute/v2.1/servers/017ce180-3d28-4cea-8c40-c113c3627273" status: 200 len: 1504 microversion: 2.1 time: 0.259650 May 26 15:00:17.266309 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 248/472] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:00:17 2021] GET /compute/v2.1/servers/017ce180-3d28-4cea-8c40-c113c3627273 => generated 1504 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:00:17.868943 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-f3967d0f-0b47-4506-8fb9-17e189699c5d tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:17.869787 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-f3967d0f-0b47-4506-8fb9-17e189699c5d tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 598b0e3f-8cf1-451a-80a8-ed7e5dd36984] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:17.885311 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-f3967d0f-0b47-4506-8fb9-17e189699c5d tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:17.886069 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-f3967d0f-0b47-4506-8fb9-17e189699c5d tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:17.887018 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-f3967d0f-0b47-4506-8fb9-17e189699c5d tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:17.887612 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-f3967d0f-0b47-4506-8fb9-17e189699c5d tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:18.138743 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-f3967d0f-0b47-4506-8fb9-17e189699c5d tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:18.153392 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-f3967d0f-0b47-4506-8fb9-17e189699c5d tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:18.154966 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-f3967d0f-0b47-4506-8fb9-17e189699c5d tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:18.156462 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-f3967d0f-0b47-4506-8fb9-17e189699c5d tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984" status: 200 len: 1738 microversion: 2.20 time: 0.293317 May 26 15:00:18.157033 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 225/473] 10.222.0.81 () {60 vars in 1277 bytes} [Wed May 26 15:00:17 2021] GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984 => generated 1738 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:00:18.171951 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-e4fb1dc6-2e8a-4404-812e-02655a6d3437 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:18.172581 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-e4fb1dc6-2e8a-4404-812e-02655a6d3437 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] [instance: aa145a33-41b1-4e39-9642-132aca11fcfe] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:18.180221 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-e4fb1dc6-2e8a-4404-812e-02655a6d3437 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:18.180709 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-e4fb1dc6-2e8a-4404-812e-02655a6d3437 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:18.181687 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-e4fb1dc6-2e8a-4404-812e-02655a6d3437 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:18.182135 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-e4fb1dc6-2e8a-4404-812e-02655a6d3437 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:18.401367 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-af60b272-787b-4411-88bf-4212b6df75f7 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Action: 'create', calling method: .version_select at 0x7f441e1dbdc0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1867552409"}} {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:00:18.429239 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.quota [None req-af60b272-787b-4411-88bf-4212b6df75f7 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Getting quotas for project 07c65d1e254f424ebfea8360aa697c34. Resources: {'key_pairs'} {{(pid=118514) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 26 15:00:18.433134 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.quota [None req-af60b272-787b-4411-88bf-4212b6df75f7 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Getting quotas for user 565618950dd54005a4a040f4dd0cbb33 and project 07c65d1e254f424ebfea8360aa697c34. Resources: {'key_pairs'} {{(pid=118514) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 26 15:00:18.538876 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-e4fb1dc6-2e8a-4404-812e-02655a6d3437 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b167942c895345b186a3eda5c82175b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad2ab2705ca479ab4aaafe7c80de162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:18.550105 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-e4fb1dc6-2e8a-4404-812e-02655a6d3437 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /compute/v2.1/servers/aa145a33-41b1-4e39-9642-132aca11fcfe" status: 200 len: 1567 microversion: 2.1 time: 0.388182 May 26 15:00:18.550689 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 249/474] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:00:18 2021] GET /compute/v2.1/servers/aa145a33-41b1-4e39-9642-132aca11fcfe => generated 1567 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:00:18.563466 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-3e2a7216-857e-414d-854b-ec66d73e9b09 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:18.570134 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-3e2a7216-857e-414d-854b-ec66d73e9b09 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] [instance: 017ce180-3d28-4cea-8c40-c113c3627273] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:18.590205 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-3e2a7216-857e-414d-854b-ec66d73e9b09 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:18.590874 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-3e2a7216-857e-414d-854b-ec66d73e9b09 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:18.591848 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-3e2a7216-857e-414d-854b-ec66d73e9b09 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:18.592457 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-3e2a7216-857e-414d-854b-ec66d73e9b09 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:18.913525 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.quota [None req-af60b272-787b-4411-88bf-4212b6df75f7 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Getting quotas for project 07c65d1e254f424ebfea8360aa697c34. Resources: {'key_pairs'} {{(pid=118514) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 26 15:00:18.930815 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.quota [None req-af60b272-787b-4411-88bf-4212b6df75f7 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Getting quotas for user 565618950dd54005a4a040f4dd0cbb33 and project 07c65d1e254f424ebfea8360aa697c34. Resources: {'key_pairs'} {{(pid=118514) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 26 15:00:18.955412 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-af60b272-787b-4411-88bf-4212b6df75f7 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 200 len: 2316 microversion: 2.1 time: 0.742009 May 26 15:00:18.956020 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 226/475] 10.222.0.81 () {60 vars in 1158 bytes} [Wed May 26 15:00:18 2021] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:00:19.175991 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-aa1cbd62-a6b0-4e9e-8c0f-bd4087bcb416 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:19.176718 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-aa1cbd62-a6b0-4e9e-8c0f-bd4087bcb416 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 598b0e3f-8cf1-451a-80a8-ed7e5dd36984] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:19.190582 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-aa1cbd62-a6b0-4e9e-8c0f-bd4087bcb416 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:19.191042 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-aa1cbd62-a6b0-4e9e-8c0f-bd4087bcb416 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:19.191825 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-aa1cbd62-a6b0-4e9e-8c0f-bd4087bcb416 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:19.194494 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-aa1cbd62-a6b0-4e9e-8c0f-bd4087bcb416 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:19.320654 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-3e2a7216-857e-414d-854b-ec66d73e9b09 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96610ea2bcf84875be6d08859dd0c7b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dffd269c3a344d36b77ebb04d0c412e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:19.330055 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-3e2a7216-857e-414d-854b-ec66d73e9b09 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] 10.222.0.81 "GET /compute/v2.1/servers/017ce180-3d28-4cea-8c40-c113c3627273" status: 200 len: 1504 microversion: 2.1 time: 0.775765 May 26 15:00:19.340259 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 250/476] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:00:18 2021] GET /compute/v2.1/servers/017ce180-3d28-4cea-8c40-c113c3627273 => generated 1504 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:00:19.567508 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-8daaf018-5bf2-4e89-b268-99330b5a2b14 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:19.568373 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-8daaf018-5bf2-4e89-b268-99330b5a2b14 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] [instance: aa145a33-41b1-4e39-9642-132aca11fcfe] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:19.582558 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-8daaf018-5bf2-4e89-b268-99330b5a2b14 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:19.585080 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-8daaf018-5bf2-4e89-b268-99330b5a2b14 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:19.586138 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-8daaf018-5bf2-4e89-b268-99330b5a2b14 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:19.590237 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-8daaf018-5bf2-4e89-b268-99330b5a2b14 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:19.794118 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-aa1cbd62-a6b0-4e9e-8c0f-bd4087bcb416 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:19.816172 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-aa1cbd62-a6b0-4e9e-8c0f-bd4087bcb416 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:19.817881 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-aa1cbd62-a6b0-4e9e-8c0f-bd4087bcb416 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:19.820405 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-aa1cbd62-a6b0-4e9e-8c0f-bd4087bcb416 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984" status: 200 len: 1720 microversion: 2.20 time: 0.648164 May 26 15:00:19.821431 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 227/477] 10.222.0.81 () {60 vars in 1277 bytes} [Wed May 26 15:00:19 2021] GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984 => generated 1720 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 15:00:19.826677 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [req-923e2487-13ea-419c-b5f9-28955a5285bc req-5f3eee4e-38c1-471b-a30f-3b24351d22fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "017ce180-3d28-4cea-8c40-c113c3627273", "name": "network-vif-deleted", "tag": "717c230d-741b-4c4f-abf3-9fd63dc119c4"}]} {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:00:19.829864 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 15:00:19.829864 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: warnings.warn(msg) May 26 15:00:19.841270 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [req-923e2487-13ea-419c-b5f9-28955a5285bc req-5f3eee4e-38c1-471b-a30f-3b24351d22fc service nova] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:19.842011 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [req-923e2487-13ea-419c-b5f9-28955a5285bc req-5f3eee4e-38c1-471b-a30f-3b24351d22fc service nova] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:19.864552 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.compute.server_external_events [req-923e2487-13ea-419c-b5f9-28955a5285bc req-5f3eee4e-38c1-471b-a30f-3b24351d22fc service nova] Creating event network-vif-deleted:717c230d-741b-4c4f-abf3-9fd63dc119c4 for instance 017ce180-3d28-4cea-8c40-c113c3627273 on hv-cinder-78414 May 26 15:00:19.869674 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [req-923e2487-13ea-419c-b5f9-28955a5285bc req-5f3eee4e-38c1-471b-a30f-3b24351d22fc service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046835 May 26 15:00:19.870835 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 228/478] 10.222.0.81 () {64 vars in 1318 bytes} [Wed May 26 15:00:19 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:00:19.874900 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-8daaf018-5bf2-4e89-b268-99330b5a2b14 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b167942c895345b186a3eda5c82175b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad2ab2705ca479ab4aaafe7c80de162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:19.885497 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-8daaf018-5bf2-4e89-b268-99330b5a2b14 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /compute/v2.1/servers/aa145a33-41b1-4e39-9642-132aca11fcfe" status: 200 len: 1567 microversion: 2.1 time: 0.321573 May 26 15:00:19.889774 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 251/479] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:00:19 2021] GET /compute/v2.1/servers/aa145a33-41b1-4e39-9642-132aca11fcfe => generated 1567 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:00:20.348736 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-1761355e-23b8-41dd-9c6e-afa8273c7a03 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:20.352453 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-1761355e-23b8-41dd-9c6e-afa8273c7a03 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] [instance: 017ce180-3d28-4cea-8c40-c113c3627273] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:20.354339 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-8805648d-b9f3-4d2c-9f44-1ce5d9e2f8b5 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1dce5df3-d467-45fd-bc36-b94bffe4e697"}} {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:00:20.355467 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-8805648d-b9f3-4d2c-9f44-1ce5d9e2f8b5 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] [instance: f4f8081b-28f4-4e9f-bf48-471d84e67da8] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:20.365453 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-1761355e-23b8-41dd-9c6e-afa8273c7a03 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:20.366454 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-1761355e-23b8-41dd-9c6e-afa8273c7a03 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:20.367957 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-1761355e-23b8-41dd-9c6e-afa8273c7a03 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:20.368561 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-1761355e-23b8-41dd-9c6e-afa8273c7a03 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:20.380300 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-8805648d-b9f3-4d2c-9f44-1ce5d9e2f8b5 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:20.380766 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-8805648d-b9f3-4d2c-9f44-1ce5d9e2f8b5 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:20.381597 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-8805648d-b9f3-4d2c-9f44-1ce5d9e2f8b5 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:20.382044 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-8805648d-b9f3-4d2c-9f44-1ce5d9e2f8b5 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:20.453123 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-1761355e-23b8-41dd-9c6e-afa8273c7a03 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:20.454288 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-1761355e-23b8-41dd-9c6e-afa8273c7a03 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:20.454907 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.objects.instance [None req-1761355e-23b8-41dd-9c6e-afa8273c7a03 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lazy-loading 'fault' on Instance uuid 017ce180-3d28-4cea-8c40-c113c3627273 {{(pid=118514) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 26 15:00:20.522258 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-1761355e-23b8-41dd-9c6e-afa8273c7a03 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96610ea2bcf84875be6d08859dd0c7b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dffd269c3a344d36b77ebb04d0c412e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:20.531503 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-1761355e-23b8-41dd-9c6e-afa8273c7a03 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] 10.222.0.81 "GET /compute/v2.1/servers/017ce180-3d28-4cea-8c40-c113c3627273" status: 200 len: 1304 microversion: 2.1 time: 0.187722 May 26 15:00:20.533004 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 229/480] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:00:20 2021] GET /compute/v2.1/servers/017ce180-3d28-4cea-8c40-c113c3627273 => generated 1304 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:00:20.612254 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.wsgi [None req-8805648d-b9f3-4d2c-9f44-1ce5d9e2f8b5 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] HTTP exception thrown: Invalid volume: volume 1dce5df3-d467-45fd-bc36-b94bffe4e697 is already attached to instances: f4f8081b-28f4-4e9f-bf48-471d84e67da8 May 26 15:00:20.613007 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-8805648d-b9f3-4d2c-9f44-1ce5d9e2f8b5 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Returning 400 to user: Invalid volume: volume 1dce5df3-d467-45fd-bc36-b94bffe4e697 is already attached to instances: f4f8081b-28f4-4e9f-bf48-471d84e67da8 {{(pid=118513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 26 15:00:20.613923 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-8805648d-b9f3-4d2c-9f44-1ce5d9e2f8b5 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "POST /compute/v2.1/servers/f4f8081b-28f4-4e9f-bf48-471d84e67da8/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.263318 May 26 15:00:20.614492 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 252/481] 10.222.0.81 () {60 vars in 1323 bytes} [Wed May 26 15:00:20 2021] POST /compute/v2.1/servers/f4f8081b-28f4-4e9f-bf48-471d84e67da8/os-volume_attachments => generated 174 bytes in 264 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 26 15:00:20.729240 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-a5223a5a-4693-4f88-a012-3b30d94648d5 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:20.729790 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-a5223a5a-4693-4f88-a012-3b30d94648d5 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] [instance: f4f8081b-28f4-4e9f-bf48-471d84e67da8] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:20.741813 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-a5223a5a-4693-4f88-a012-3b30d94648d5 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:20.742977 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-a5223a5a-4693-4f88-a012-3b30d94648d5 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:20.743966 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-a5223a5a-4693-4f88-a012-3b30d94648d5 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:20.744549 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-a5223a5a-4693-4f88-a012-3b30d94648d5 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:20.844143 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-22e655c8-bc64-4d72-932b-29d765db4769 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:20.850399 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-22e655c8-bc64-4d72-932b-29d765db4769 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 598b0e3f-8cf1-451a-80a8-ed7e5dd36984] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:20.858550 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-22e655c8-bc64-4d72-932b-29d765db4769 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:20.859647 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-22e655c8-bc64-4d72-932b-29d765db4769 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:20.862589 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-22e655c8-bc64-4d72-932b-29d765db4769 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:20.863354 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-22e655c8-bc64-4d72-932b-29d765db4769 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:20.921351 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.objects.instance [None req-a5223a5a-4693-4f88-a012-3b30d94648d5 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lazy-loading 'services' on Instance uuid f4f8081b-28f4-4e9f-bf48-471d84e67da8 {{(pid=118514) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 26 15:00:21.112619 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-22e655c8-bc64-4d72-932b-29d765db4769 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:21.123501 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-22e655c8-bc64-4d72-932b-29d765db4769 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:21.126368 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-22e655c8-bc64-4d72-932b-29d765db4769 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:21.127684 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-22e655c8-bc64-4d72-932b-29d765db4769 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984" status: 200 len: 1720 microversion: 2.20 time: 0.287293 May 26 15:00:21.128750 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 253/482] 10.222.0.81 () {60 vars in 1277 bytes} [Wed May 26 15:00:20 2021] GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984 => generated 1720 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 15:00:21.144735 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-e21e82b4-ff81-4cba-9533-e73d4b0d5d33 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:21.145650 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-e21e82b4-ff81-4cba-9533-e73d4b0d5d33 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] [instance: aa145a33-41b1-4e39-9642-132aca11fcfe] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:21.153396 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-e21e82b4-ff81-4cba-9533-e73d4b0d5d33 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:21.154107 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-e21e82b4-ff81-4cba-9533-e73d4b0d5d33 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:21.154900 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-e21e82b4-ff81-4cba-9533-e73d4b0d5d33 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:21.155340 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-e21e82b4-ff81-4cba-9533-e73d4b0d5d33 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:21.237712 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-a5223a5a-4693-4f88-a012-3b30d94648d5 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "DELETE /compute/v2.1/servers/f4f8081b-28f4-4e9f-bf48-471d84e67da8/os-volume_attachments/1dce5df3-d467-45fd-bc36-b94bffe4e697" status: 202 len: 0 microversion: 2.1 time: 0.512079 May 26 15:00:21.241808 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 230/483] 10.222.0.81 () {58 vars in 1416 bytes} [Wed May 26 15:00:20 2021] DELETE /compute/v2.1/servers/f4f8081b-28f4-4e9f-bf48-471d84e67da8/os-volume_attachments/1dce5df3-d467-45fd-bc36-b94bffe4e697 => generated 0 bytes in 517 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 15:00:21.413383 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-e21e82b4-ff81-4cba-9533-e73d4b0d5d33 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b167942c895345b186a3eda5c82175b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad2ab2705ca479ab4aaafe7c80de162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:21.422650 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-e21e82b4-ff81-4cba-9533-e73d4b0d5d33 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /compute/v2.1/servers/aa145a33-41b1-4e39-9642-132aca11fcfe" status: 200 len: 1567 microversion: 2.1 time: 0.282215 May 26 15:00:21.423176 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 254/484] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:00:21 2021] GET /compute/v2.1/servers/aa145a33-41b1-4e39-9642-132aca11fcfe => generated 1567 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:00:21.550953 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-73b0cdcf-d298-48c4-a66a-70485aceb300 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:21.551672 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-73b0cdcf-d298-48c4-a66a-70485aceb300 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] [instance: 017ce180-3d28-4cea-8c40-c113c3627273] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:21.567561 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-73b0cdcf-d298-48c4-a66a-70485aceb300 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:21.568030 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-73b0cdcf-d298-48c4-a66a-70485aceb300 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:21.568833 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-73b0cdcf-d298-48c4-a66a-70485aceb300 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:21.569280 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-73b0cdcf-d298-48c4-a66a-70485aceb300 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:21.649066 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-73b0cdcf-d298-48c4-a66a-70485aceb300 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:21.649530 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-73b0cdcf-d298-48c4-a66a-70485aceb300 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:21.650033 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.objects.instance [None req-73b0cdcf-d298-48c4-a66a-70485aceb300 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lazy-loading 'fault' on Instance uuid 017ce180-3d28-4cea-8c40-c113c3627273 {{(pid=118514) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 26 15:00:21.711655 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-73b0cdcf-d298-48c4-a66a-70485aceb300 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96610ea2bcf84875be6d08859dd0c7b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dffd269c3a344d36b77ebb04d0c412e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:21.720850 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-73b0cdcf-d298-48c4-a66a-70485aceb300 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] 10.222.0.81 "GET /compute/v2.1/servers/017ce180-3d28-4cea-8c40-c113c3627273" status: 200 len: 1304 microversion: 2.1 time: 0.174525 May 26 15:00:21.730517 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 231/485] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:00:21 2021] GET /compute/v2.1/servers/017ce180-3d28-4cea-8c40-c113c3627273 => generated 1304 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:00:22.145426 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-dba31b5f-e4a9-48fa-bd55-47207b69e5c4 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:22.146066 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-dba31b5f-e4a9-48fa-bd55-47207b69e5c4 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 598b0e3f-8cf1-451a-80a8-ed7e5dd36984] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:22.154003 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-dba31b5f-e4a9-48fa-bd55-47207b69e5c4 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:22.161701 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-dba31b5f-e4a9-48fa-bd55-47207b69e5c4 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:22.161701 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-dba31b5f-e4a9-48fa-bd55-47207b69e5c4 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:22.161701 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-dba31b5f-e4a9-48fa-bd55-47207b69e5c4 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:22.446499 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-b44616ac-09f2-4956-93dd-75e9f3b22520 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:22.450008 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-b44616ac-09f2-4956-93dd-75e9f3b22520 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] [instance: aa145a33-41b1-4e39-9642-132aca11fcfe] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:22.482966 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-b44616ac-09f2-4956-93dd-75e9f3b22520 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:22.483699 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-b44616ac-09f2-4956-93dd-75e9f3b22520 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:22.484983 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-b44616ac-09f2-4956-93dd-75e9f3b22520 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:22.485780 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-b44616ac-09f2-4956-93dd-75e9f3b22520 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:22.588830 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-dba31b5f-e4a9-48fa-bd55-47207b69e5c4 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:22.617851 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-dba31b5f-e4a9-48fa-bd55-47207b69e5c4 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:22.619693 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-dba31b5f-e4a9-48fa-bd55-47207b69e5c4 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:22.620850 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-dba31b5f-e4a9-48fa-bd55-47207b69e5c4 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984" status: 200 len: 1720 microversion: 2.20 time: 0.479255 May 26 15:00:22.621413 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 255/486] 10.222.0.81 () {60 vars in 1277 bytes} [Wed May 26 15:00:22 2021] GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984 => generated 1720 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:00:22.738397 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-e52c6f75-050f-4bd6-a095-eb333b57345e tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:22.739191 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-e52c6f75-050f-4bd6-a095-eb333b57345e tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] [instance: 017ce180-3d28-4cea-8c40-c113c3627273] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:22.748438 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-b44616ac-09f2-4956-93dd-75e9f3b22520 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b167942c895345b186a3eda5c82175b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad2ab2705ca479ab4aaafe7c80de162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:22.749603 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-e52c6f75-050f-4bd6-a095-eb333b57345e tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:22.750284 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-e52c6f75-050f-4bd6-a095-eb333b57345e tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:22.752881 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-e52c6f75-050f-4bd6-a095-eb333b57345e tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:22.753612 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-e52c6f75-050f-4bd6-a095-eb333b57345e tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:22.758331 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-b44616ac-09f2-4956-93dd-75e9f3b22520 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /compute/v2.1/servers/aa145a33-41b1-4e39-9642-132aca11fcfe" status: 200 len: 1567 microversion: 2.1 time: 0.322328 May 26 15:00:22.769307 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 232/487] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:00:22 2021] GET /compute/v2.1/servers/aa145a33-41b1-4e39-9642-132aca11fcfe => generated 1567 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:00:22.824138 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-e52c6f75-050f-4bd6-a095-eb333b57345e tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:22.824686 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-e52c6f75-050f-4bd6-a095-eb333b57345e tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:22.825216 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.objects.instance [None req-e52c6f75-050f-4bd6-a095-eb333b57345e tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lazy-loading 'fault' on Instance uuid 017ce180-3d28-4cea-8c40-c113c3627273 {{(pid=118513) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 26 15:00:22.988783 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-e52c6f75-050f-4bd6-a095-eb333b57345e tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96610ea2bcf84875be6d08859dd0c7b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dffd269c3a344d36b77ebb04d0c412e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:22.998658 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-e52c6f75-050f-4bd6-a095-eb333b57345e tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] 10.222.0.81 "GET /compute/v2.1/servers/017ce180-3d28-4cea-8c40-c113c3627273" status: 200 len: 1304 microversion: 2.1 time: 0.263812 May 26 15:00:22.999180 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 256/488] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:00:22 2021] GET /compute/v2.1/servers/017ce180-3d28-4cea-8c40-c113c3627273 => generated 1304 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:00:23.639174 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-022bb1c2-e19f-4cbd-81e4-5493d4a77273 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:23.640043 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-022bb1c2-e19f-4cbd-81e4-5493d4a77273 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 598b0e3f-8cf1-451a-80a8-ed7e5dd36984] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:23.647328 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-022bb1c2-e19f-4cbd-81e4-5493d4a77273 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:23.647785 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-022bb1c2-e19f-4cbd-81e4-5493d4a77273 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:23.648603 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-022bb1c2-e19f-4cbd-81e4-5493d4a77273 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:23.649055 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-022bb1c2-e19f-4cbd-81e4-5493d4a77273 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:23.777510 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-67f42678-880b-4679-b681-1a52068aab65 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:23.778087 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-67f42678-880b-4679-b681-1a52068aab65 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] [instance: aa145a33-41b1-4e39-9642-132aca11fcfe] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:23.787748 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-67f42678-880b-4679-b681-1a52068aab65 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:23.788469 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-67f42678-880b-4679-b681-1a52068aab65 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:23.789435 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-67f42678-880b-4679-b681-1a52068aab65 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:23.789901 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-67f42678-880b-4679-b681-1a52068aab65 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:23.860302 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-022bb1c2-e19f-4cbd-81e4-5493d4a77273 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:23.871576 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-022bb1c2-e19f-4cbd-81e4-5493d4a77273 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:23.884846 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-022bb1c2-e19f-4cbd-81e4-5493d4a77273 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:23.887753 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-022bb1c2-e19f-4cbd-81e4-5493d4a77273 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984" status: 200 len: 1720 microversion: 2.20 time: 0.252254 May 26 15:00:23.888911 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 233/489] 10.222.0.81 () {60 vars in 1277 bytes} [Wed May 26 15:00:23 2021] GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984 => generated 1720 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:00:24.015496 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-96ddb97d-c2a7-427a-83ea-ca531c557a8f tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:24.017489 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-96ddb97d-c2a7-427a-83ea-ca531c557a8f tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] [instance: 017ce180-3d28-4cea-8c40-c113c3627273] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:24.029951 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-67f42678-880b-4679-b681-1a52068aab65 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b167942c895345b186a3eda5c82175b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad2ab2705ca479ab4aaafe7c80de162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:24.031715 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-96ddb97d-c2a7-427a-83ea-ca531c557a8f tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:24.032767 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-96ddb97d-c2a7-427a-83ea-ca531c557a8f tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:24.033577 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-96ddb97d-c2a7-427a-83ea-ca531c557a8f tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:24.034930 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-96ddb97d-c2a7-427a-83ea-ca531c557a8f tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:24.041783 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-67f42678-880b-4679-b681-1a52068aab65 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /compute/v2.1/servers/aa145a33-41b1-4e39-9642-132aca11fcfe" status: 200 len: 1567 microversion: 2.1 time: 0.269188 May 26 15:00:24.042476 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 257/490] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:00:23 2021] GET /compute/v2.1/servers/aa145a33-41b1-4e39-9642-132aca11fcfe => generated 1567 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:00:24.086178 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.wsgi [None req-96ddb97d-c2a7-427a-83ea-ca531c557a8f tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] HTTP exception thrown: Instance 017ce180-3d28-4cea-8c40-c113c3627273 could not be found. May 26 15:00:24.086985 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-96ddb97d-c2a7-427a-83ea-ca531c557a8f tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Returning 404 to user: Instance 017ce180-3d28-4cea-8c40-c113c3627273 could not be found. {{(pid=118514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 26 15:00:24.088020 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-96ddb97d-c2a7-427a-83ea-ca531c557a8f tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] 10.222.0.81 "GET /compute/v2.1/servers/017ce180-3d28-4cea-8c40-c113c3627273" status: 404 len: 111 microversion: 2.1 time: 0.076390 May 26 15:00:24.089015 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 234/491] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:00:24 2021] GET /compute/v2.1/servers/017ce180-3d28-4cea-8c40-c113c3627273 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 15:00:24.232405 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-465583ce-41b4-4b55-9fe4-1a90eb7c3a3a tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1160691886", "imageRef": "dcacad62-e278-4869-aa20-e5df07dd03db", "flavorRef": "452", "networks": [{"uuid": "85b44080-2458-40a2-bbbd-894b0448370a"}]}} {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:00:24.253782 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [req-eb8f627d-8a08-446b-9e34-82345c7691b6 req-16e5d9ec-518c-4a6d-a5a4-fb23b2432c43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "598b0e3f-8cf1-451a-80a8-ed7e5dd36984", "name": "network-vif-unplugged", "status": "completed", "tag": "e948d481-711f-45b8-8deb-08b7658709e7"}]} {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:00:24.255572 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 15:00:24.255572 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: warnings.warn(msg) May 26 15:00:24.264553 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [req-eb8f627d-8a08-446b-9e34-82345c7691b6 req-16e5d9ec-518c-4a6d-a5a4-fb23b2432c43 service nova] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:24.265021 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [req-eb8f627d-8a08-446b-9e34-82345c7691b6 req-16e5d9ec-518c-4a6d-a5a4-fb23b2432c43 service nova] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:24.282256 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.compute.server_external_events [req-eb8f627d-8a08-446b-9e34-82345c7691b6 req-16e5d9ec-518c-4a6d-a5a4-fb23b2432c43 service nova] Creating event network-vif-unplugged:e948d481-711f-45b8-8deb-08b7658709e7 for instance 598b0e3f-8cf1-451a-80a8-ed7e5dd36984 on hv-cinder-78414 May 26 15:00:24.287615 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [req-eb8f627d-8a08-446b-9e34-82345c7691b6 req-16e5d9ec-518c-4a6d-a5a4-fb23b2432c43 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038065 May 26 15:00:24.288859 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 235/492] 10.222.0.81 () {64 vars in 1318 bytes} [Wed May 26 15:00:24 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 15:00:24.304513 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.network.neutron [None req-465583ce-41b4-4b55-9fe4-1a90eb7c3a3a tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] validate_networks() for [('85b44080-2458-40a2-bbbd-894b0448370a', None, None, None)] {{(pid=118513) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} May 26 15:00:24.831349 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-9557a1b0-ce70-4a92-926e-ae3341e882ae tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-690272842", "imageRef": "dcacad62-e278-4869-aa20-e5df07dd03db", "flavorRef": "452", "networks": [{"uuid": "5bdb145e-267b-43cd-9426-f92f373c5ed5"}]}} {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:00:24.895671 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.virt.hardware [None req-465583ce-41b4-4b55-9fe4-1a90eb7c3a3a tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Flavor limits 0:0:0 {{(pid=118513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} May 26 15:00:24.896225 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.virt.hardware [None req-465583ce-41b4-4b55-9fe4-1a90eb7c3a3a tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Image limits 0:0:0 {{(pid=118513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} May 26 15:00:24.896598 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.virt.hardware [None req-465583ce-41b4-4b55-9fe4-1a90eb7c3a3a tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Flavor pref 0:0:0 {{(pid=118513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} May 26 15:00:24.897016 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.virt.hardware [None req-465583ce-41b4-4b55-9fe4-1a90eb7c3a3a tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Image pref 0:0:0 {{(pid=118513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} May 26 15:00:24.897439 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.virt.hardware [None req-465583ce-41b4-4b55-9fe4-1a90eb7c3a3a tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} May 26 15:00:24.900573 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.network.neutron [None req-9557a1b0-ce70-4a92-926e-ae3341e882ae tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] validate_networks() for [('5bdb145e-267b-43cd-9426-f92f373c5ed5', None, None, None)] {{(pid=118514) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} May 26 15:00:24.907719 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-465583ce-41b4-4b55-9fe4-1a90eb7c3a3a tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:24.908192 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-465583ce-41b4-4b55-9fe4-1a90eb7c3a3a tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:24.909112 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-465583ce-41b4-4b55-9fe4-1a90eb7c3a3a tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:24.909596 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-465583ce-41b4-4b55-9fe4-1a90eb7c3a3a tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:24.931708 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.quota [None req-465583ce-41b4-4b55-9fe4-1a90eb7c3a3a tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Getting quotas for project dffd269c3a344d36b77ebb04d0c412e3. Resources: {'instances', 'ram', 'cores'} {{(pid=118513) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 26 15:00:24.935694 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.quota [None req-465583ce-41b4-4b55-9fe4-1a90eb7c3a3a tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Getting quotas for user 96610ea2bcf84875be6d08859dd0c7b4 and project dffd269c3a344d36b77ebb04d0c412e3. Resources: {'instances', 'ram', 'cores'} {{(pid=118513) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 26 15:00:24.949348 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-465583ce-41b4-4b55-9fe4-1a90eb7c3a3a tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Going to run 1 instances... {{(pid=118513) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 26 15:00:24.951992 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-465583ce-41b4-4b55-9fe4-1a90eb7c3a3a tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] [instance: 8e4e2075-5a0f-4e15-892d-e4b5eb5b8807] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dcacad62-e278-4869-aa20-e5df07dd03db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118513) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} May 26 15:00:25.121813 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-465583ce-41b4-4b55-9fe4-1a90eb7c3a3a tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.892318 May 26 15:00:25.124029 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 258/493] 10.222.0.81 () {60 vars in 1147 bytes} [Wed May 26 15:00:24 2021] POST /compute/v2.1/servers => generated 380 bytes in 896 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 15:00:25.131528 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-aa0f3384-216d-4650-8964-5337fdbc5476 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:25.133001 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-aa0f3384-216d-4650-8964-5337fdbc5476 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 598b0e3f-8cf1-451a-80a8-ed7e5dd36984] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:25.144839 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-aa0f3384-216d-4650-8964-5337fdbc5476 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:25.145398 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-aa0f3384-216d-4650-8964-5337fdbc5476 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:25.146324 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-aa0f3384-216d-4650-8964-5337fdbc5476 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:25.146841 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-aa0f3384-216d-4650-8964-5337fdbc5476 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:25.381323 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-aa0f3384-216d-4650-8964-5337fdbc5476 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:25.390294 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-aa0f3384-216d-4650-8964-5337fdbc5476 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:25.392567 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-aa0f3384-216d-4650-8964-5337fdbc5476 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:25.393769 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-aa0f3384-216d-4650-8964-5337fdbc5476 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984" status: 200 len: 1720 microversion: 2.20 time: 0.268386 May 26 15:00:25.394332 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 259/494] 10.222.0.81 () {60 vars in 1277 bytes} [Wed May 26 15:00:25 2021] GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984 => generated 1720 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:00:25.398833 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-4b5acdfe-4eef-4761-b26e-92d2eaff6b20 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:25.399449 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-4b5acdfe-4eef-4761-b26e-92d2eaff6b20 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] [instance: aa145a33-41b1-4e39-9642-132aca11fcfe] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:25.408154 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-4b5acdfe-4eef-4761-b26e-92d2eaff6b20 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:25.408615 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-4b5acdfe-4eef-4761-b26e-92d2eaff6b20 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:25.409410 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-4b5acdfe-4eef-4761-b26e-92d2eaff6b20 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:25.409881 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-4b5acdfe-4eef-4761-b26e-92d2eaff6b20 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:25.503659 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.virt.hardware [None req-9557a1b0-ce70-4a92-926e-ae3341e882ae tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Flavor limits 0:0:0 {{(pid=118514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} May 26 15:00:25.504129 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.virt.hardware [None req-9557a1b0-ce70-4a92-926e-ae3341e882ae tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Image limits 0:0:0 {{(pid=118514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} May 26 15:00:25.504669 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.virt.hardware [None req-9557a1b0-ce70-4a92-926e-ae3341e882ae tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Flavor pref 0:0:0 {{(pid=118514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} May 26 15:00:25.505117 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.virt.hardware [None req-9557a1b0-ce70-4a92-926e-ae3341e882ae tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Image pref 0:0:0 {{(pid=118514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} May 26 15:00:25.505555 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.virt.hardware [None req-9557a1b0-ce70-4a92-926e-ae3341e882ae tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} May 26 15:00:25.514548 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-9557a1b0-ce70-4a92-926e-ae3341e882ae tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:25.515006 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-9557a1b0-ce70-4a92-926e-ae3341e882ae tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:25.515872 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-9557a1b0-ce70-4a92-926e-ae3341e882ae tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:25.516805 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-9557a1b0-ce70-4a92-926e-ae3341e882ae tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:25.537415 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.quota [None req-9557a1b0-ce70-4a92-926e-ae3341e882ae tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Getting quotas for project 1515325707f64d58a28f26451b2c74de. Resources: {'instances', 'ram', 'cores'} {{(pid=118514) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 26 15:00:25.543755 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.quota [None req-9557a1b0-ce70-4a92-926e-ae3341e882ae tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Getting quotas for user 1be4bd5c0f2a400da491bae101b48832 and project 1515325707f64d58a28f26451b2c74de. Resources: {'instances', 'ram', 'cores'} {{(pid=118514) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 26 15:00:25.554992 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-9557a1b0-ce70-4a92-926e-ae3341e882ae tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Going to run 1 instances... {{(pid=118514) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 26 15:00:25.557440 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-9557a1b0-ce70-4a92-926e-ae3341e882ae tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] [instance: 4266a63b-9328-4c00-81d2-3583ceb5d080] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dcacad62-e278-4869-aa20-e5df07dd03db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118514) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} May 26 15:00:25.635649 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-4b5acdfe-4eef-4761-b26e-92d2eaff6b20 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b167942c895345b186a3eda5c82175b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad2ab2705ca479ab4aaafe7c80de162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:25.645554 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-4b5acdfe-4eef-4761-b26e-92d2eaff6b20 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /compute/v2.1/servers/aa145a33-41b1-4e39-9642-132aca11fcfe" status: 200 len: 1567 microversion: 2.1 time: 0.250096 May 26 15:00:25.646214 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 260/495] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:00:25 2021] GET /compute/v2.1/servers/aa145a33-41b1-4e39-9642-132aca11fcfe => generated 1567 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:00:25.650535 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-6041af17-c06b-404c-bf6f-685269dfed85 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:25.651414 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-6041af17-c06b-404c-bf6f-685269dfed85 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] [instance: 8e4e2075-5a0f-4e15-892d-e4b5eb5b8807] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:25.708647 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-9557a1b0-ce70-4a92-926e-ae3341e882ae tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.882273 May 26 15:00:25.709753 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 236/496] 10.222.0.81 () {60 vars in 1147 bytes} [Wed May 26 15:00:24 2021] POST /compute/v2.1/servers => generated 380 bytes in 884 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 26 15:00:25.719605 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-b6f97f71-683e-4bb7-a870-6a79ece482cd tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:25.720271 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-b6f97f71-683e-4bb7-a870-6a79ece482cd tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] [instance: 4266a63b-9328-4c00-81d2-3583ceb5d080] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:25.722378 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-6041af17-c06b-404c-bf6f-685269dfed85 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96610ea2bcf84875be6d08859dd0c7b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dffd269c3a344d36b77ebb04d0c412e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:25.731091 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-6041af17-c06b-404c-bf6f-685269dfed85 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] 10.222.0.81 "GET /compute/v2.1/servers/8e4e2075-5a0f-4e15-892d-e4b5eb5b8807" status: 200 len: 1214 microversion: 2.1 time: 0.083640 May 26 15:00:25.731713 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 261/497] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:00:25 2021] GET /compute/v2.1/servers/8e4e2075-5a0f-4e15-892d-e4b5eb5b8807 => generated 1214 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:00:25.805245 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-b6f97f71-683e-4bb7-a870-6a79ece482cd tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be4bd5c0f2a400da491bae101b48832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515325707f64d58a28f26451b2c74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:25.813679 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-b6f97f71-683e-4bb7-a870-6a79ece482cd tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /compute/v2.1/servers/4266a63b-9328-4c00-81d2-3583ceb5d080" status: 200 len: 1217 microversion: 2.1 time: 0.097306 May 26 15:00:25.814306 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 237/498] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:00:25 2021] GET /compute/v2.1/servers/4266a63b-9328-4c00-81d2-3583ceb5d080 => generated 1217 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:00:26.412742 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-b76a34b0-081a-462f-bc83-07c1beee47fa tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:26.413357 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-b76a34b0-081a-462f-bc83-07c1beee47fa tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 598b0e3f-8cf1-451a-80a8-ed7e5dd36984] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:26.421057 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-b76a34b0-081a-462f-bc83-07c1beee47fa tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:26.421525 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-b76a34b0-081a-462f-bc83-07c1beee47fa tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:26.422329 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-b76a34b0-081a-462f-bc83-07c1beee47fa tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:26.423515 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-b76a34b0-081a-462f-bc83-07c1beee47fa tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:26.625123 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-b76a34b0-081a-462f-bc83-07c1beee47fa tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:26.634235 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-b76a34b0-081a-462f-bc83-07c1beee47fa tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:26.635731 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-b76a34b0-081a-462f-bc83-07c1beee47fa tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:26.636842 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-b76a34b0-081a-462f-bc83-07c1beee47fa tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984" status: 200 len: 1720 microversion: 2.20 time: 0.227821 May 26 15:00:26.637400 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 262/499] 10.222.0.81 () {60 vars in 1277 bytes} [Wed May 26 15:00:26 2021] GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984 => generated 1720 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:00:26.663217 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-a8b3d11f-d8c1-454c-b7f6-29f3976b477f tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:26.663764 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-a8b3d11f-d8c1-454c-b7f6-29f3976b477f tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] [instance: aa145a33-41b1-4e39-9642-132aca11fcfe] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:26.671303 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-a8b3d11f-d8c1-454c-b7f6-29f3976b477f tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:26.671762 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-a8b3d11f-d8c1-454c-b7f6-29f3976b477f tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:26.673130 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-a8b3d11f-d8c1-454c-b7f6-29f3976b477f tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:26.673605 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-a8b3d11f-d8c1-454c-b7f6-29f3976b477f tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:26.747835 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-e39a9dfe-2533-4070-b27f-e4d2d1e3be15 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:26.748747 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-e39a9dfe-2533-4070-b27f-e4d2d1e3be15 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] [instance: 8e4e2075-5a0f-4e15-892d-e4b5eb5b8807] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:26.756573 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-e39a9dfe-2533-4070-b27f-e4d2d1e3be15 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:26.757337 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-e39a9dfe-2533-4070-b27f-e4d2d1e3be15 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:26.758443 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-e39a9dfe-2533-4070-b27f-e4d2d1e3be15 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:26.758987 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-e39a9dfe-2533-4070-b27f-e4d2d1e3be15 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:26.877701 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-e39a9dfe-2533-4070-b27f-e4d2d1e3be15 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96610ea2bcf84875be6d08859dd0c7b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dffd269c3a344d36b77ebb04d0c412e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:26.886190 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-e39a9dfe-2533-4070-b27f-e4d2d1e3be15 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] 10.222.0.81 "GET /compute/v2.1/servers/8e4e2075-5a0f-4e15-892d-e4b5eb5b8807" status: 200 len: 1218 microversion: 2.1 time: 0.141878 May 26 15:00:26.886782 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 263/500] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:00:26 2021] GET /compute/v2.1/servers/8e4e2075-5a0f-4e15-892d-e4b5eb5b8807 => generated 1218 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:00:26.892116 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-3cd7d3a3-9820-4ef4-82e3-5ae74d43a9d6 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:26.892730 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-3cd7d3a3-9820-4ef4-82e3-5ae74d43a9d6 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] [instance: 4266a63b-9328-4c00-81d2-3583ceb5d080] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:26.899693 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-3cd7d3a3-9820-4ef4-82e3-5ae74d43a9d6 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:26.900144 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-3cd7d3a3-9820-4ef4-82e3-5ae74d43a9d6 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:26.901178 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-3cd7d3a3-9820-4ef4-82e3-5ae74d43a9d6 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:26.901634 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-3cd7d3a3-9820-4ef4-82e3-5ae74d43a9d6 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:26.958502 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-a8b3d11f-d8c1-454c-b7f6-29f3976b477f tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b167942c895345b186a3eda5c82175b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad2ab2705ca479ab4aaafe7c80de162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:26.967347 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-a8b3d11f-d8c1-454c-b7f6-29f3976b477f tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /compute/v2.1/servers/aa145a33-41b1-4e39-9642-132aca11fcfe" status: 200 len: 1567 microversion: 2.1 time: 0.307824 May 26 15:00:26.978025 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 238/501] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:00:26 2021] GET /compute/v2.1/servers/aa145a33-41b1-4e39-9642-132aca11fcfe => generated 1567 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:00:27.019450 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-3cd7d3a3-9820-4ef4-82e3-5ae74d43a9d6 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be4bd5c0f2a400da491bae101b48832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515325707f64d58a28f26451b2c74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:27.027753 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-3cd7d3a3-9820-4ef4-82e3-5ae74d43a9d6 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /compute/v2.1/servers/4266a63b-9328-4c00-81d2-3583ceb5d080" status: 200 len: 1221 microversion: 2.1 time: 0.140010 May 26 15:00:27.028311 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 264/502] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:00:26 2021] GET /compute/v2.1/servers/4266a63b-9328-4c00-81d2-3583ceb5d080 => generated 1221 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:00:27.655249 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-5dc31ff2-eb95-4b81-adb1-a2a9355e9f57 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:27.660422 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-5dc31ff2-eb95-4b81-adb1-a2a9355e9f57 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 598b0e3f-8cf1-451a-80a8-ed7e5dd36984] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:27.663702 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-5dc31ff2-eb95-4b81-adb1-a2a9355e9f57 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:27.664237 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-5dc31ff2-eb95-4b81-adb1-a2a9355e9f57 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:27.664911 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-5dc31ff2-eb95-4b81-adb1-a2a9355e9f57 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:27.665353 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-5dc31ff2-eb95-4b81-adb1-a2a9355e9f57 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:27.868166 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-5dc31ff2-eb95-4b81-adb1-a2a9355e9f57 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:27.878203 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-5dc31ff2-eb95-4b81-adb1-a2a9355e9f57 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:27.879725 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-5dc31ff2-eb95-4b81-adb1-a2a9355e9f57 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:27.880849 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-5dc31ff2-eb95-4b81-adb1-a2a9355e9f57 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984" status: 200 len: 1720 microversion: 2.20 time: 0.229329 May 26 15:00:27.881409 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 239/503] 10.222.0.81 () {60 vars in 1277 bytes} [Wed May 26 15:00:27 2021] GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984 => generated 1720 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:00:27.903358 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-aa4ea59b-88b3-4a19-8b64-15b3c231fdbc tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:27.903969 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-aa4ea59b-88b3-4a19-8b64-15b3c231fdbc tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] [instance: 8e4e2075-5a0f-4e15-892d-e4b5eb5b8807] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:27.911765 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-aa4ea59b-88b3-4a19-8b64-15b3c231fdbc tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:27.912418 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-aa4ea59b-88b3-4a19-8b64-15b3c231fdbc tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:27.912976 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-aa4ea59b-88b3-4a19-8b64-15b3c231fdbc tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:27.913412 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-aa4ea59b-88b3-4a19-8b64-15b3c231fdbc tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:27.986375 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-ae79ae01-efd0-4239-90ba-7b70b8fa31e5 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:27.987057 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-ae79ae01-efd0-4239-90ba-7b70b8fa31e5 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] [instance: aa145a33-41b1-4e39-9642-132aca11fcfe] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:27.994688 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-ae79ae01-efd0-4239-90ba-7b70b8fa31e5 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:27.995157 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-ae79ae01-efd0-4239-90ba-7b70b8fa31e5 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:27.995996 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-ae79ae01-efd0-4239-90ba-7b70b8fa31e5 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:27.996456 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-ae79ae01-efd0-4239-90ba-7b70b8fa31e5 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:28.030198 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-aa4ea59b-88b3-4a19-8b64-15b3c231fdbc tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96610ea2bcf84875be6d08859dd0c7b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dffd269c3a344d36b77ebb04d0c412e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:28.039088 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-aa4ea59b-88b3-4a19-8b64-15b3c231fdbc tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] 10.222.0.81 "GET /compute/v2.1/servers/8e4e2075-5a0f-4e15-892d-e4b5eb5b8807" status: 200 len: 1218 microversion: 2.1 time: 0.139468 May 26 15:00:28.039552 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 265/504] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:00:27 2021] GET /compute/v2.1/servers/8e4e2075-5a0f-4e15-892d-e4b5eb5b8807 => generated 1218 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:00:28.043791 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-d3bcb9eb-ef9c-4f9a-818d-fa8e9b937b8c tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:28.044393 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-d3bcb9eb-ef9c-4f9a-818d-fa8e9b937b8c tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] [instance: 4266a63b-9328-4c00-81d2-3583ceb5d080] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:28.052630 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-d3bcb9eb-ef9c-4f9a-818d-fa8e9b937b8c tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:28.053083 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-d3bcb9eb-ef9c-4f9a-818d-fa8e9b937b8c tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:28.053891 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-d3bcb9eb-ef9c-4f9a-818d-fa8e9b937b8c tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:28.054331 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-d3bcb9eb-ef9c-4f9a-818d-fa8e9b937b8c tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:28.164336 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-d3bcb9eb-ef9c-4f9a-818d-fa8e9b937b8c tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be4bd5c0f2a400da491bae101b48832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515325707f64d58a28f26451b2c74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:28.173165 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-d3bcb9eb-ef9c-4f9a-818d-fa8e9b937b8c tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /compute/v2.1/servers/4266a63b-9328-4c00-81d2-3583ceb5d080" status: 200 len: 1221 microversion: 2.1 time: 0.132027 May 26 15:00:28.173989 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 266/505] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:00:28 2021] GET /compute/v2.1/servers/4266a63b-9328-4c00-81d2-3583ceb5d080 => generated 1221 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:00:28.196320 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-ae79ae01-efd0-4239-90ba-7b70b8fa31e5 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b167942c895345b186a3eda5c82175b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad2ab2705ca479ab4aaafe7c80de162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:28.205108 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-ae79ae01-efd0-4239-90ba-7b70b8fa31e5 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /compute/v2.1/servers/aa145a33-41b1-4e39-9642-132aca11fcfe" status: 200 len: 1567 microversion: 2.1 time: 0.223134 May 26 15:00:28.206375 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 240/506] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:00:27 2021] GET /compute/v2.1/servers/aa145a33-41b1-4e39-9642-132aca11fcfe => generated 1567 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:00:28.899654 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-a01ae768-6a28-47ab-ae32-fe1d7828b944 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:28.900332 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-a01ae768-6a28-47ab-ae32-fe1d7828b944 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 598b0e3f-8cf1-451a-80a8-ed7e5dd36984] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:28.908510 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-a01ae768-6a28-47ab-ae32-fe1d7828b944 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:28.909063 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-a01ae768-6a28-47ab-ae32-fe1d7828b944 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:28.909782 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-a01ae768-6a28-47ab-ae32-fe1d7828b944 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:28.910222 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-a01ae768-6a28-47ab-ae32-fe1d7828b944 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:29.056234 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-3fd1be23-5491-47c3-b412-2cda12f5b672 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:29.056849 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-3fd1be23-5491-47c3-b412-2cda12f5b672 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] [instance: 8e4e2075-5a0f-4e15-892d-e4b5eb5b8807] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:29.064922 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-3fd1be23-5491-47c3-b412-2cda12f5b672 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:29.065368 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-3fd1be23-5491-47c3-b412-2cda12f5b672 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:29.066216 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-3fd1be23-5491-47c3-b412-2cda12f5b672 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:29.066605 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-3fd1be23-5491-47c3-b412-2cda12f5b672 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:29.116559 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-a01ae768-6a28-47ab-ae32-fe1d7828b944 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:29.126184 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-a01ae768-6a28-47ab-ae32-fe1d7828b944 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:29.127879 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-a01ae768-6a28-47ab-ae32-fe1d7828b944 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:29.129097 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-a01ae768-6a28-47ab-ae32-fe1d7828b944 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984" status: 200 len: 1720 microversion: 2.20 time: 0.233795 May 26 15:00:29.129776 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 267/507] 10.222.0.81 () {60 vars in 1277 bytes} [Wed May 26 15:00:28 2021] GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984 => generated 1720 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:00:29.183225 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-3fd1be23-5491-47c3-b412-2cda12f5b672 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96610ea2bcf84875be6d08859dd0c7b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dffd269c3a344d36b77ebb04d0c412e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:29.190298 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-881452d9-b17d-4ba9-aef2-cd9a10190765 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:29.190906 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-881452d9-b17d-4ba9-aef2-cd9a10190765 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] [instance: 4266a63b-9328-4c00-81d2-3583ceb5d080] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:29.192200 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-3fd1be23-5491-47c3-b412-2cda12f5b672 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] 10.222.0.81 "GET /compute/v2.1/servers/8e4e2075-5a0f-4e15-892d-e4b5eb5b8807" status: 200 len: 1210 microversion: 2.1 time: 0.139712 May 26 15:00:29.192782 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 241/508] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:00:29 2021] GET /compute/v2.1/servers/8e4e2075-5a0f-4e15-892d-e4b5eb5b8807 => generated 1210 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:00:29.198015 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-881452d9-b17d-4ba9-aef2-cd9a10190765 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:29.198464 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-881452d9-b17d-4ba9-aef2-cd9a10190765 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:29.199236 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-881452d9-b17d-4ba9-aef2-cd9a10190765 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:29.199692 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-881452d9-b17d-4ba9-aef2-cd9a10190765 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:29.227298 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-216c63a7-d3a9-4ece-84ca-094863fc8558 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:29.227938 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-216c63a7-d3a9-4ece-84ca-094863fc8558 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] [instance: aa145a33-41b1-4e39-9642-132aca11fcfe] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:29.235722 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-216c63a7-d3a9-4ece-84ca-094863fc8558 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:29.236177 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-216c63a7-d3a9-4ece-84ca-094863fc8558 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:29.236960 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-216c63a7-d3a9-4ece-84ca-094863fc8558 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:29.237398 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-216c63a7-d3a9-4ece-84ca-094863fc8558 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:29.312877 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-881452d9-b17d-4ba9-aef2-cd9a10190765 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be4bd5c0f2a400da491bae101b48832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515325707f64d58a28f26451b2c74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:29.321701 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-881452d9-b17d-4ba9-aef2-cd9a10190765 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /compute/v2.1/servers/4266a63b-9328-4c00-81d2-3583ceb5d080" status: 200 len: 1269 microversion: 2.1 time: 0.135463 May 26 15:00:29.322469 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 268/509] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:00:29 2021] GET /compute/v2.1/servers/4266a63b-9328-4c00-81d2-3583ceb5d080 => generated 1269 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:00:29.440690 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-216c63a7-d3a9-4ece-84ca-094863fc8558 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b167942c895345b186a3eda5c82175b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad2ab2705ca479ab4aaafe7c80de162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:29.448698 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-216c63a7-d3a9-4ece-84ca-094863fc8558 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /compute/v2.1/servers/aa145a33-41b1-4e39-9642-132aca11fcfe" status: 200 len: 1567 microversion: 2.1 time: 0.224969 May 26 15:00:29.449710 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 242/510] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:00:29 2021] GET /compute/v2.1/servers/aa145a33-41b1-4e39-9642-132aca11fcfe => generated 1567 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:00:30.158300 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-73128506-9f4a-4a5b-ac9c-54989f5bd8c1 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:30.159114 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-73128506-9f4a-4a5b-ac9c-54989f5bd8c1 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 598b0e3f-8cf1-451a-80a8-ed7e5dd36984] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:30.166544 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-73128506-9f4a-4a5b-ac9c-54989f5bd8c1 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:30.167007 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-73128506-9f4a-4a5b-ac9c-54989f5bd8c1 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:30.167801 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-73128506-9f4a-4a5b-ac9c-54989f5bd8c1 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:30.168246 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-73128506-9f4a-4a5b-ac9c-54989f5bd8c1 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:30.208668 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-5f927055-d2c1-4a78-943f-de1606058959 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:30.209279 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-5f927055-d2c1-4a78-943f-de1606058959 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] [instance: 8e4e2075-5a0f-4e15-892d-e4b5eb5b8807] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:30.224348 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-5f927055-d2c1-4a78-943f-de1606058959 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:30.225268 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-5f927055-d2c1-4a78-943f-de1606058959 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:30.226856 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-5f927055-d2c1-4a78-943f-de1606058959 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:30.227598 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-5f927055-d2c1-4a78-943f-de1606058959 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:30.377478 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-5f927055-d2c1-4a78-943f-de1606058959 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96610ea2bcf84875be6d08859dd0c7b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dffd269c3a344d36b77ebb04d0c412e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:30.387163 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-5f927055-d2c1-4a78-943f-de1606058959 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] 10.222.0.81 "GET /compute/v2.1/servers/8e4e2075-5a0f-4e15-892d-e4b5eb5b8807" status: 200 len: 1274 microversion: 2.1 time: 0.181979 May 26 15:00:30.390757 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 243/511] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:00:30 2021] GET /compute/v2.1/servers/8e4e2075-5a0f-4e15-892d-e4b5eb5b8807 => generated 1274 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:00:30.398600 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-51e69492-c747-41b3-9b37-d4c6b204adcc tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:30.399242 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-51e69492-c747-41b3-9b37-d4c6b204adcc tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] [instance: 4266a63b-9328-4c00-81d2-3583ceb5d080] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:30.406896 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-51e69492-c747-41b3-9b37-d4c6b204adcc tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:30.407583 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-51e69492-c747-41b3-9b37-d4c6b204adcc tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:30.408231 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-51e69492-c747-41b3-9b37-d4c6b204adcc tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:30.408729 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-51e69492-c747-41b3-9b37-d4c6b204adcc tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:30.653170 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-73128506-9f4a-4a5b-ac9c-54989f5bd8c1 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:30.664966 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-73128506-9f4a-4a5b-ac9c-54989f5bd8c1 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:30.666471 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-73128506-9f4a-4a5b-ac9c-54989f5bd8c1 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:30.667629 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-73128506-9f4a-4a5b-ac9c-54989f5bd8c1 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984" status: 200 len: 1723 microversion: 2.20 time: 0.522615 May 26 15:00:30.680681 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 269/512] 10.222.0.81 () {60 vars in 1277 bytes} [Wed May 26 15:00:30 2021] GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984 => generated 1723 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:00:30.681695 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-d53c026f-ddcc-4a56-9f32-eb40aead596f tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:30.682497 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-d53c026f-ddcc-4a56-9f32-eb40aead596f tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] [instance: aa145a33-41b1-4e39-9642-132aca11fcfe] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:30.690979 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-d53c026f-ddcc-4a56-9f32-eb40aead596f tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:30.697093 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-d53c026f-ddcc-4a56-9f32-eb40aead596f tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:30.697093 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-d53c026f-ddcc-4a56-9f32-eb40aead596f tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:30.697093 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-d53c026f-ddcc-4a56-9f32-eb40aead596f tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:31.097033 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-51e69492-c747-41b3-9b37-d4c6b204adcc tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be4bd5c0f2a400da491bae101b48832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515325707f64d58a28f26451b2c74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:31.105518 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-51e69492-c747-41b3-9b37-d4c6b204adcc tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /compute/v2.1/servers/4266a63b-9328-4c00-81d2-3583ceb5d080" status: 200 len: 1317 microversion: 2.1 time: 0.713924 May 26 15:00:31.106356 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 244/513] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:00:30 2021] GET /compute/v2.1/servers/4266a63b-9328-4c00-81d2-3583ceb5d080 => generated 1317 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:00:31.111440 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-3d7d5413-9599-4369-8b83-01cbc8307340 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "90c40fb9-fd58-4ae9-aafa-03598f2fb385"}} {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:00:31.113575 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-3d7d5413-9599-4369-8b83-01cbc8307340 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 598b0e3f-8cf1-451a-80a8-ed7e5dd36984] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:31.120426 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-3d7d5413-9599-4369-8b83-01cbc8307340 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:31.120897 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-3d7d5413-9599-4369-8b83-01cbc8307340 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:31.121717 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-3d7d5413-9599-4369-8b83-01cbc8307340 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:31.122164 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-3d7d5413-9599-4369-8b83-01cbc8307340 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:31.192100 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-d53c026f-ddcc-4a56-9f32-eb40aead596f tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b167942c895345b186a3eda5c82175b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad2ab2705ca479ab4aaafe7c80de162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:31.208293 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-d53c026f-ddcc-4a56-9f32-eb40aead596f tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /compute/v2.1/servers/aa145a33-41b1-4e39-9642-132aca11fcfe" status: 200 len: 1567 microversion: 2.1 time: 0.530187 May 26 15:00:31.209161 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 270/514] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:00:30 2021] GET /compute/v2.1/servers/aa145a33-41b1-4e39-9642-132aca11fcfe => generated 1567 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:00:31.405352 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-0d4d0cdc-53b6-497c-9de3-3b128ed295c4 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:31.406521 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-0d4d0cdc-53b6-497c-9de3-3b128ed295c4 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] [instance: 8e4e2075-5a0f-4e15-892d-e4b5eb5b8807] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:31.414829 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-0d4d0cdc-53b6-497c-9de3-3b128ed295c4 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:31.415316 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-0d4d0cdc-53b6-497c-9de3-3b128ed295c4 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:31.416054 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-0d4d0cdc-53b6-497c-9de3-3b128ed295c4 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:31.416499 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-0d4d0cdc-53b6-497c-9de3-3b128ed295c4 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:31.555192 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-0d4d0cdc-53b6-497c-9de3-3b128ed295c4 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96610ea2bcf84875be6d08859dd0c7b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dffd269c3a344d36b77ebb04d0c412e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:31.566892 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-0d4d0cdc-53b6-497c-9de3-3b128ed295c4 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] 10.222.0.81 "GET /compute/v2.1/servers/8e4e2075-5a0f-4e15-892d-e4b5eb5b8807" status: 200 len: 1272 microversion: 2.1 time: 0.165890 May 26 15:00:31.571984 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 271/515] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:00:31 2021] GET /compute/v2.1/servers/8e4e2075-5a0f-4e15-892d-e4b5eb5b8807 => generated 1272 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:00:32.123263 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-a5ef5f5d-08a2-4876-b131-e68283f08d35 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:32.124285 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-a5ef5f5d-08a2-4876-b131-e68283f08d35 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] [instance: 4266a63b-9328-4c00-81d2-3583ceb5d080] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:32.137153 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-a5ef5f5d-08a2-4876-b131-e68283f08d35 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:32.140491 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-a5ef5f5d-08a2-4876-b131-e68283f08d35 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:32.141808 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-a5ef5f5d-08a2-4876-b131-e68283f08d35 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:32.142562 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-a5ef5f5d-08a2-4876-b131-e68283f08d35 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:32.482458 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-3d7d5413-9599-4369-8b83-01cbc8307340 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "POST /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.375193 May 26 15:00:32.483129 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 245/516] 10.222.0.81 () {62 vars in 1364 bytes} [Wed May 26 15:00:31 2021] POST /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984/os-volume_attachments => generated 188 bytes in 1376 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 15:00:32.495741 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [req-a24a8270-160b-44e8-91b0-b38afca2379a req-89de1fd9-38e4-4dbf-943e-536dc1f76177 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4266a63b-9328-4c00-81d2-3583ceb5d080", "tag": "7b7c8c36-6397-47d6-91bb-4f1db62a6e1a"}]} {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:00:32.498198 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 15:00:32.498198 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: warnings.warn(msg) May 26 15:00:32.511360 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [req-a24a8270-160b-44e8-91b0-b38afca2379a req-89de1fd9-38e4-4dbf-943e-536dc1f76177 service nova] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:32.512104 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [req-a24a8270-160b-44e8-91b0-b38afca2379a req-89de1fd9-38e4-4dbf-943e-536dc1f76177 service nova] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:32.515818 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-a5ef5f5d-08a2-4876-b131-e68283f08d35 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be4bd5c0f2a400da491bae101b48832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515325707f64d58a28f26451b2c74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:32.527309 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-a5ef5f5d-08a2-4876-b131-e68283f08d35 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /compute/v2.1/servers/4266a63b-9328-4c00-81d2-3583ceb5d080" status: 200 len: 1317 microversion: 2.1 time: 0.407912 May 26 15:00:32.528277 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 272/517] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:00:32 2021] GET /compute/v2.1/servers/4266a63b-9328-4c00-81d2-3583ceb5d080 => generated 1317 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:00:32.533504 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-7ed1361e-cb49-40db-8e74-a0cfffdcfa69 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:32.534340 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-7ed1361e-cb49-40db-8e74-a0cfffdcfa69 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] [instance: aa145a33-41b1-4e39-9642-132aca11fcfe] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:32.537663 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.compute.server_external_events [req-a24a8270-160b-44e8-91b0-b38afca2379a req-89de1fd9-38e4-4dbf-943e-536dc1f76177 service nova] Creating event network-changed:7b7c8c36-6397-47d6-91bb-4f1db62a6e1a for instance 4266a63b-9328-4c00-81d2-3583ceb5d080 on hv-cinder-78414 May 26 15:00:32.541926 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-7ed1361e-cb49-40db-8e74-a0cfffdcfa69 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:32.542393 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-7ed1361e-cb49-40db-8e74-a0cfffdcfa69 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:32.543193 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-7ed1361e-cb49-40db-8e74-a0cfffdcfa69 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:32.543642 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-7ed1361e-cb49-40db-8e74-a0cfffdcfa69 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:32.548732 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [req-a24a8270-160b-44e8-91b0-b38afca2379a req-89de1fd9-38e4-4dbf-943e-536dc1f76177 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062412 May 26 15:00:32.549279 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 246/518] 10.222.0.81 () {64 vars in 1318 bytes} [Wed May 26 15:00:32 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:00:32.587663 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-35e83f89-c87c-48ea-9131-53c5251e761d tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:32.589240 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-35e83f89-c87c-48ea-9131-53c5251e761d tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] [instance: 8e4e2075-5a0f-4e15-892d-e4b5eb5b8807] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:32.599142 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-35e83f89-c87c-48ea-9131-53c5251e761d tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:32.599897 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-35e83f89-c87c-48ea-9131-53c5251e761d tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:32.600891 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-35e83f89-c87c-48ea-9131-53c5251e761d tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:32.601534 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-35e83f89-c87c-48ea-9131-53c5251e761d tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:32.970632 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-35e83f89-c87c-48ea-9131-53c5251e761d tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96610ea2bcf84875be6d08859dd0c7b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dffd269c3a344d36b77ebb04d0c412e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:32.982902 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-35e83f89-c87c-48ea-9131-53c5251e761d tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] 10.222.0.81 "GET /compute/v2.1/servers/8e4e2075-5a0f-4e15-892d-e4b5eb5b8807" status: 200 len: 1314 microversion: 2.1 time: 0.399064 May 26 15:00:32.983972 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 247/519] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:00:32 2021] GET /compute/v2.1/servers/8e4e2075-5a0f-4e15-892d-e4b5eb5b8807 => generated 1314 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:00:32.988084 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-5aeae36e-3a3f-4f6f-8e34-23f57b02a93a tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:00:32.988788 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-5aeae36e-3a3f-4f6f-8e34-23f57b02a93a tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 598b0e3f-8cf1-451a-80a8-ed7e5dd36984] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:32.996213 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-5aeae36e-3a3f-4f6f-8e34-23f57b02a93a tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:32.997406 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-5aeae36e-3a3f-4f6f-8e34-23f57b02a93a tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:32.997656 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-5aeae36e-3a3f-4f6f-8e34-23f57b02a93a tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:32.998067 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-5aeae36e-3a3f-4f6f-8e34-23f57b02a93a tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:33.010684 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-7ed1361e-cb49-40db-8e74-a0cfffdcfa69 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b167942c895345b186a3eda5c82175b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad2ab2705ca479ab4aaafe7c80de162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:33.023159 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-7ed1361e-cb49-40db-8e74-a0cfffdcfa69 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /compute/v2.1/servers/aa145a33-41b1-4e39-9642-132aca11fcfe" status: 200 len: 1567 microversion: 2.1 time: 0.493821 May 26 15:00:33.026282 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 273/520] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:00:32 2021] GET /compute/v2.1/servers/aa145a33-41b1-4e39-9642-132aca11fcfe => generated 1567 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:00:33.263217 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [req-60849696-3351-4daa-8b94-7e1b4628d5bb req-21e56b3d-5de1-47a0-8032-229e9efd0db3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e4e2075-5a0f-4e15-892d-e4b5eb5b8807", "tag": "e2b86960-bb59-4f27-9951-ec442358a17d"}]} {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:00:33.278362 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 15:00:33.278362 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: warnings.warn(msg) May 26 15:00:33.287090 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [req-60849696-3351-4daa-8b94-7e1b4628d5bb req-21e56b3d-5de1-47a0-8032-229e9efd0db3 service nova] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:33.287644 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [req-60849696-3351-4daa-8b94-7e1b4628d5bb req-21e56b3d-5de1-47a0-8032-229e9efd0db3 service nova] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:33.304599 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.compute.server_external_events [req-60849696-3351-4daa-8b94-7e1b4628d5bb req-21e56b3d-5de1-47a0-8032-229e9efd0db3 service nova] Creating event network-changed:e2b86960-bb59-4f27-9951-ec442358a17d for instance 8e4e2075-5a0f-4e15-892d-e4b5eb5b8807 on hv-cinder-78414 May 26 15:00:33.310378 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [req-60849696-3351-4daa-8b94-7e1b4628d5bb req-21e56b3d-5de1-47a0-8032-229e9efd0db3 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054385 May 26 15:00:33.311414 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 274/521] 10.222.0.81 () {64 vars in 1318 bytes} [Wed May 26 15:00:33 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 15:00:33.449789 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-7c6930d2-f210-45e3-b645-34dd5eb62431 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:33.450547 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-7c6930d2-f210-45e3-b645-34dd5eb62431 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] [instance: 990431e1-82cb-42b0-a288-949d79e21762] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:33.475055 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-5aeae36e-3a3f-4f6f-8e34-23f57b02a93a tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "POST /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984/action" status: 202 len: 0 microversion: 2.20 time: 0.490649 May 26 15:00:33.476116 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 248/522] 10.222.0.81 () {62 vars in 1319 bytes} [Wed May 26 15:00:32 2021] POST /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984/action => generated 0 bytes in 492 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 26 15:00:33.482155 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-7c6930d2-f210-45e3-b645-34dd5eb62431 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:33.485071 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-04badf84-e46c-4912-be28-c576e0f421c7 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:33.485732 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-7c6930d2-f210-45e3-b645-34dd5eb62431 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:33.486511 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-04badf84-e46c-4912-be28-c576e0f421c7 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 598b0e3f-8cf1-451a-80a8-ed7e5dd36984] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:33.501137 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-7c6930d2-f210-45e3-b645-34dd5eb62431 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:33.501137 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-7c6930d2-f210-45e3-b645-34dd5eb62431 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:33.503550 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-04badf84-e46c-4912-be28-c576e0f421c7 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:33.504175 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-04badf84-e46c-4912-be28-c576e0f421c7 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:33.505160 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-04badf84-e46c-4912-be28-c576e0f421c7 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:33.505858 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-04badf84-e46c-4912-be28-c576e0f421c7 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:33.710131 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.objects.instance [None req-7c6930d2-f210-45e3-b645-34dd5eb62431 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lazy-loading 'services' on Instance uuid 990431e1-82cb-42b0-a288-949d79e21762 {{(pid=118513) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 26 15:00:33.983133 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-04badf84-e46c-4912-be28-c576e0f421c7 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:33.996943 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-04badf84-e46c-4912-be28-c576e0f421c7 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:33.998504 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-04badf84-e46c-4912-be28-c576e0f421c7 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:33.999675 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-04badf84-e46c-4912-be28-c576e0f421c7 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984" status: 200 len: 1749 microversion: 2.20 time: 0.519449 May 26 15:00:34.001027 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 249/523] 10.222.0.81 () {60 vars in 1277 bytes} [Wed May 26 15:00:33 2021] GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984 => generated 1749 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 15:00:34.006276 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-8982a54f-73ee-4940-b4ef-7a67fff31eb2 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:34.006895 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-8982a54f-73ee-4940-b4ef-7a67fff31eb2 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] [instance: 4266a63b-9328-4c00-81d2-3583ceb5d080] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:34.017000 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-8982a54f-73ee-4940-b4ef-7a67fff31eb2 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:34.017000 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-8982a54f-73ee-4940-b4ef-7a67fff31eb2 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:34.017834 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-8982a54f-73ee-4940-b4ef-7a67fff31eb2 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:34.018281 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-8982a54f-73ee-4940-b4ef-7a67fff31eb2 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:34.078632 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-7c6930d2-f210-45e3-b645-34dd5eb62431 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] 10.222.0.81 "DELETE /compute/v2.1/servers/990431e1-82cb-42b0-a288-949d79e21762/os-volume_attachments/155cc33a-6799-4058-b13c-998fa5a78ec1" status: 202 len: 0 microversion: 2.1 time: 0.632466 May 26 15:00:34.083105 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 275/524] 10.222.0.81 () {58 vars in 1416 bytes} [Wed May 26 15:00:33 2021] DELETE /compute/v2.1/servers/990431e1-82cb-42b0-a288-949d79e21762/os-volume_attachments/155cc33a-6799-4058-b13c-998fa5a78ec1 => generated 0 bytes in 638 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 15:00:34.089388 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-e42907c1-df50-44aa-8810-204e910730d7 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:34.090708 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-e42907c1-df50-44aa-8810-204e910730d7 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] [instance: 8e4e2075-5a0f-4e15-892d-e4b5eb5b8807] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:34.100956 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-e42907c1-df50-44aa-8810-204e910730d7 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:34.101490 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-e42907c1-df50-44aa-8810-204e910730d7 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:34.102773 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-e42907c1-df50-44aa-8810-204e910730d7 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:34.103474 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-e42907c1-df50-44aa-8810-204e910730d7 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:34.369108 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-8982a54f-73ee-4940-b4ef-7a67fff31eb2 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be4bd5c0f2a400da491bae101b48832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515325707f64d58a28f26451b2c74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:34.380387 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-8982a54f-73ee-4940-b4ef-7a67fff31eb2 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /compute/v2.1/servers/4266a63b-9328-4c00-81d2-3583ceb5d080" status: 200 len: 1317 microversion: 2.1 time: 0.377362 May 26 15:00:34.381674 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 250/525] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:00:34 2021] GET /compute/v2.1/servers/4266a63b-9328-4c00-81d2-3583ceb5d080 => generated 1317 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:00:34.390880 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-e1580e60-e590-4db9-9473-864e38d9370d tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:34.392370 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-e1580e60-e590-4db9-9473-864e38d9370d tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] [instance: aa145a33-41b1-4e39-9642-132aca11fcfe] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:34.403286 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-e1580e60-e590-4db9-9473-864e38d9370d tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:34.404059 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-e1580e60-e590-4db9-9473-864e38d9370d tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:34.405208 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-e1580e60-e590-4db9-9473-864e38d9370d tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:34.405854 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-e1580e60-e590-4db9-9473-864e38d9370d tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:34.660465 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-e42907c1-df50-44aa-8810-204e910730d7 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96610ea2bcf84875be6d08859dd0c7b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dffd269c3a344d36b77ebb04d0c412e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:34.675990 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-e42907c1-df50-44aa-8810-204e910730d7 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] 10.222.0.81 "GET /compute/v2.1/servers/8e4e2075-5a0f-4e15-892d-e4b5eb5b8807" status: 200 len: 1314 microversion: 2.1 time: 0.591271 May 26 15:00:34.677457 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 276/526] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:00:34 2021] GET /compute/v2.1/servers/8e4e2075-5a0f-4e15-892d-e4b5eb5b8807 => generated 1314 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:00:34.701111 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-e1580e60-e590-4db9-9473-864e38d9370d tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b167942c895345b186a3eda5c82175b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad2ab2705ca479ab4aaafe7c80de162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:34.712464 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-e1580e60-e590-4db9-9473-864e38d9370d tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /compute/v2.1/servers/aa145a33-41b1-4e39-9642-132aca11fcfe" status: 200 len: 1567 microversion: 2.1 time: 0.329458 May 26 15:00:34.715170 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 251/527] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:00:34 2021] GET /compute/v2.1/servers/aa145a33-41b1-4e39-9642-132aca11fcfe => generated 1567 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:00:35.018731 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-85420024-5f97-4604-af40-b53f7245405e tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:35.181303 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-85420024-5f97-4604-af40-b53f7245405e tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 598b0e3f-8cf1-451a-80a8-ed7e5dd36984] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:35.181303 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-85420024-5f97-4604-af40-b53f7245405e tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:35.181303 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-85420024-5f97-4604-af40-b53f7245405e tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:35.181303 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-85420024-5f97-4604-af40-b53f7245405e tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:35.182311 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-85420024-5f97-4604-af40-b53f7245405e tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:35.235910 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-85420024-5f97-4604-af40-b53f7245405e tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:35.246901 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-85420024-5f97-4604-af40-b53f7245405e tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:35.248507 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-85420024-5f97-4604-af40-b53f7245405e tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:35.249755 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-85420024-5f97-4604-af40-b53f7245405e tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984" status: 200 len: 1749 microversion: 2.20 time: 0.234777 May 26 15:00:35.251352 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 277/528] 10.222.0.81 () {60 vars in 1277 bytes} [Wed May 26 15:00:35 2021] GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984 => generated 1749 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:00:35.397567 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-e7287ced-7e61-4fcc-8844-87fdc03a16fe tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:35.398196 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-e7287ced-7e61-4fcc-8844-87fdc03a16fe tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] [instance: 4266a63b-9328-4c00-81d2-3583ceb5d080] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:35.408622 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-e7287ced-7e61-4fcc-8844-87fdc03a16fe tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:35.409158 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-e7287ced-7e61-4fcc-8844-87fdc03a16fe tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:35.409889 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-e7287ced-7e61-4fcc-8844-87fdc03a16fe tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:35.410332 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-e7287ced-7e61-4fcc-8844-87fdc03a16fe tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:35.624863 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-e7287ced-7e61-4fcc-8844-87fdc03a16fe tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be4bd5c0f2a400da491bae101b48832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515325707f64d58a28f26451b2c74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:35.633396 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-e7287ced-7e61-4fcc-8844-87fdc03a16fe tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /compute/v2.1/servers/4266a63b-9328-4c00-81d2-3583ceb5d080" status: 200 len: 1317 microversion: 2.1 time: 0.239449 May 26 15:00:35.634011 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 252/529] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:00:35 2021] GET /compute/v2.1/servers/4266a63b-9328-4c00-81d2-3583ceb5d080 => generated 1317 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:00:35.694778 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-4550e46b-de57-4768-b7d3-067c61f11dc8 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:35.695923 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-4550e46b-de57-4768-b7d3-067c61f11dc8 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] [instance: 8e4e2075-5a0f-4e15-892d-e4b5eb5b8807] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:35.707708 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-4550e46b-de57-4768-b7d3-067c61f11dc8 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:35.708109 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-4550e46b-de57-4768-b7d3-067c61f11dc8 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:35.709009 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-4550e46b-de57-4768-b7d3-067c61f11dc8 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:35.709560 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-4550e46b-de57-4768-b7d3-067c61f11dc8 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:35.729172 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-176bf8a7-1ec3-4568-9fb3-8f5c0464492b tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:35.729805 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-176bf8a7-1ec3-4568-9fb3-8f5c0464492b tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] [instance: aa145a33-41b1-4e39-9642-132aca11fcfe] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:35.738344 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-176bf8a7-1ec3-4568-9fb3-8f5c0464492b tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:35.738799 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-176bf8a7-1ec3-4568-9fb3-8f5c0464492b tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:35.739577 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-176bf8a7-1ec3-4568-9fb3-8f5c0464492b tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:35.740014 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-176bf8a7-1ec3-4568-9fb3-8f5c0464492b tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:35.947160 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-4550e46b-de57-4768-b7d3-067c61f11dc8 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96610ea2bcf84875be6d08859dd0c7b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dffd269c3a344d36b77ebb04d0c412e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:35.957803 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-4550e46b-de57-4768-b7d3-067c61f11dc8 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] 10.222.0.81 "GET /compute/v2.1/servers/8e4e2075-5a0f-4e15-892d-e4b5eb5b8807" status: 200 len: 1314 microversion: 2.1 time: 0.268034 May 26 15:00:35.958604 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 278/530] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:00:35 2021] GET /compute/v2.1/servers/8e4e2075-5a0f-4e15-892d-e4b5eb5b8807 => generated 1314 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:00:35.967922 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-176bf8a7-1ec3-4568-9fb3-8f5c0464492b tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b167942c895345b186a3eda5c82175b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad2ab2705ca479ab4aaafe7c80de162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:35.978319 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-176bf8a7-1ec3-4568-9fb3-8f5c0464492b tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /compute/v2.1/servers/aa145a33-41b1-4e39-9642-132aca11fcfe" status: 200 len: 1567 microversion: 2.1 time: 0.252768 May 26 15:00:35.983349 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 253/531] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:00:35 2021] GET /compute/v2.1/servers/aa145a33-41b1-4e39-9642-132aca11fcfe => generated 1567 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:00:36.269550 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-39200179-4cea-4c01-9591-bdeb690b62a0 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:36.271542 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-39200179-4cea-4c01-9591-bdeb690b62a0 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 598b0e3f-8cf1-451a-80a8-ed7e5dd36984] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:36.279513 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-39200179-4cea-4c01-9591-bdeb690b62a0 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:36.280087 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-39200179-4cea-4c01-9591-bdeb690b62a0 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:36.280993 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-39200179-4cea-4c01-9591-bdeb690b62a0 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:36.281579 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-39200179-4cea-4c01-9591-bdeb690b62a0 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:36.483790 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-39200179-4cea-4c01-9591-bdeb690b62a0 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:36.493529 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-39200179-4cea-4c01-9591-bdeb690b62a0 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:36.495069 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-39200179-4cea-4c01-9591-bdeb690b62a0 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:36.496210 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-39200179-4cea-4c01-9591-bdeb690b62a0 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984" status: 200 len: 1751 microversion: 2.20 time: 0.231610 May 26 15:00:36.496775 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 279/532] 10.222.0.81 () {60 vars in 1277 bytes} [Wed May 26 15:00:36 2021] GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984 => generated 1751 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:00:36.569310 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-ec9e9921-0f67-4571-8b14-a15cda4ed47d tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:36.569848 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-ec9e9921-0f67-4571-8b14-a15cda4ed47d tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] [instance: 990431e1-82cb-42b0-a288-949d79e21762] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:36.577079 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-ec9e9921-0f67-4571-8b14-a15cda4ed47d tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:36.577561 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-ec9e9921-0f67-4571-8b14-a15cda4ed47d tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:36.578355 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-ec9e9921-0f67-4571-8b14-a15cda4ed47d tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:36.578843 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-ec9e9921-0f67-4571-8b14-a15cda4ed47d tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:36.637869 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-ec9e9921-0f67-4571-8b14-a15cda4ed47d tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] [instance: 990431e1-82cb-42b0-a288-949d79e21762] Going to try to terminate instance {{(pid=118514) delete /opt/stack/nova/nova/compute/api.py:2539}} May 26 15:00:36.650356 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-ff5cdfc7-015d-4906-a4d7-69e353732c88 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:36.651222 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-ff5cdfc7-015d-4906-a4d7-69e353732c88 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] [instance: 4266a63b-9328-4c00-81d2-3583ceb5d080] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:36.659422 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-ff5cdfc7-015d-4906-a4d7-69e353732c88 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:36.659882 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-ff5cdfc7-015d-4906-a4d7-69e353732c88 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:36.661026 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-ff5cdfc7-015d-4906-a4d7-69e353732c88 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:36.661477 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-ff5cdfc7-015d-4906-a4d7-69e353732c88 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:36.872855 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-ff5cdfc7-015d-4906-a4d7-69e353732c88 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be4bd5c0f2a400da491bae101b48832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515325707f64d58a28f26451b2c74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:36.882754 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-ff5cdfc7-015d-4906-a4d7-69e353732c88 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /compute/v2.1/servers/4266a63b-9328-4c00-81d2-3583ceb5d080" status: 200 len: 1317 microversion: 2.1 time: 0.236011 May 26 15:00:36.883333 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 280/533] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:00:36 2021] GET /compute/v2.1/servers/4266a63b-9328-4c00-81d2-3583ceb5d080 => generated 1317 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:00:36.975344 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-9b2153c3-c20f-4721-9931-043f9dd73f7b tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:36.975893 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-9b2153c3-c20f-4721-9931-043f9dd73f7b tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] [instance: 8e4e2075-5a0f-4e15-892d-e4b5eb5b8807] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:36.983026 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-9b2153c3-c20f-4721-9931-043f9dd73f7b tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:36.983489 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-9b2153c3-c20f-4721-9931-043f9dd73f7b tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:36.984267 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-9b2153c3-c20f-4721-9931-043f9dd73f7b tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:36.984756 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-9b2153c3-c20f-4721-9931-043f9dd73f7b tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:37.037169 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-ec9e9921-0f67-4571-8b14-a15cda4ed47d tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] 10.222.0.81 "DELETE /compute/v2.1/servers/990431e1-82cb-42b0-a288-949d79e21762" status: 204 len: 0 microversion: 2.1 time: 0.471282 May 26 15:00:37.038423 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 254/534] 10.222.0.81 () {58 vars in 1239 bytes} [Wed May 26 15:00:36 2021] DELETE /compute/v2.1/servers/990431e1-82cb-42b0-a288-949d79e21762 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 15:00:37.043729 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-96e9697a-57e6-42ba-8fc1-be2a3faa84b7 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:37.044424 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-96e9697a-57e6-42ba-8fc1-be2a3faa84b7 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] [instance: aa145a33-41b1-4e39-9642-132aca11fcfe] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:37.052424 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-96e9697a-57e6-42ba-8fc1-be2a3faa84b7 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:37.052881 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-96e9697a-57e6-42ba-8fc1-be2a3faa84b7 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:37.053694 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-96e9697a-57e6-42ba-8fc1-be2a3faa84b7 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:37.054132 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-96e9697a-57e6-42ba-8fc1-be2a3faa84b7 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:37.198904 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-9b2153c3-c20f-4721-9931-043f9dd73f7b tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96610ea2bcf84875be6d08859dd0c7b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dffd269c3a344d36b77ebb04d0c412e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:37.207958 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-9b2153c3-c20f-4721-9931-043f9dd73f7b tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] 10.222.0.81 "GET /compute/v2.1/servers/8e4e2075-5a0f-4e15-892d-e4b5eb5b8807" status: 200 len: 1314 microversion: 2.1 time: 0.236295 May 26 15:00:37.217123 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 281/535] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:00:36 2021] GET /compute/v2.1/servers/8e4e2075-5a0f-4e15-892d-e4b5eb5b8807 => generated 1314 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:00:37.217123 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-027deb6b-cfde-46c1-b1a4-c805d0435958 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:37.217123 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-027deb6b-cfde-46c1-b1a4-c805d0435958 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] [instance: 990431e1-82cb-42b0-a288-949d79e21762] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:37.223338 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-027deb6b-cfde-46c1-b1a4-c805d0435958 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:37.223770 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-027deb6b-cfde-46c1-b1a4-c805d0435958 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:37.224568 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-027deb6b-cfde-46c1-b1a4-c805d0435958 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:37.225179 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-027deb6b-cfde-46c1-b1a4-c805d0435958 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:37.269238 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-96e9697a-57e6-42ba-8fc1-be2a3faa84b7 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b167942c895345b186a3eda5c82175b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad2ab2705ca479ab4aaafe7c80de162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:37.278660 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-96e9697a-57e6-42ba-8fc1-be2a3faa84b7 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /compute/v2.1/servers/aa145a33-41b1-4e39-9642-132aca11fcfe" status: 200 len: 1547 microversion: 2.1 time: 0.238915 May 26 15:00:37.279328 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 255/536] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:00:37 2021] GET /compute/v2.1/servers/aa145a33-41b1-4e39-9642-132aca11fcfe => generated 1547 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:00:37.295824 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-c6438a44-c3c2-46ab-a5af-19c969a0f957 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:37.296328 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-c6438a44-c3c2-46ab-a5af-19c969a0f957 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] [instance: aa145a33-41b1-4e39-9642-132aca11fcfe] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:37.303725 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-c6438a44-c3c2-46ab-a5af-19c969a0f957 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:37.304186 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-c6438a44-c3c2-46ab-a5af-19c969a0f957 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:37.304975 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-c6438a44-c3c2-46ab-a5af-19c969a0f957 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:37.305422 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-c6438a44-c3c2-46ab-a5af-19c969a0f957 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:37.428495 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-027deb6b-cfde-46c1-b1a4-c805d0435958 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8604f942d44fec96828cc0b1ae5960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b729993a1944061bb0a708877c95a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:37.436817 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-027deb6b-cfde-46c1-b1a4-c805d0435958 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] 10.222.0.81 "GET /compute/v2.1/servers/990431e1-82cb-42b0-a288-949d79e21762" status: 200 len: 1515 microversion: 2.1 time: 0.227272 May 26 15:00:37.437393 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 282/537] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:00:37 2021] GET /compute/v2.1/servers/990431e1-82cb-42b0-a288-949d79e21762 => generated 1515 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:00:37.475175 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.wsgi [None req-c6438a44-c3c2-46ab-a5af-19c969a0f957 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] HTTP exception thrown: Cannot 'detach_volume' instance aa145a33-41b1-4e39-9642-132aca11fcfe while it is in vm_state rescued May 26 15:00:37.475774 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-c6438a44-c3c2-46ab-a5af-19c969a0f957 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Returning 409 to user: Cannot 'detach_volume' instance aa145a33-41b1-4e39-9642-132aca11fcfe while it is in vm_state rescued {{(pid=118514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 26 15:00:37.476595 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-c6438a44-c3c2-46ab-a5af-19c969a0f957 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "DELETE /compute/v2.1/servers/aa145a33-41b1-4e39-9642-132aca11fcfe/os-volume_attachments/f0feefca-b280-4489-8686-ba0694fc3620" status: 409 len: 152 microversion: 2.1 time: 0.184707 May 26 15:00:37.477136 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 256/538] 10.222.0.81 () {58 vars in 1416 bytes} [Wed May 26 15:00:37 2021] DELETE /compute/v2.1/servers/aa145a33-41b1-4e39-9642-132aca11fcfe/os-volume_attachments/f0feefca-b280-4489-8686-ba0694fc3620 => generated 152 bytes in 186 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) May 26 15:00:37.485613 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-d96b21e9-25b1-4f86-acb8-ae989df6d96b tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:00:37.486301 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-d96b21e9-25b1-4f86-acb8-ae989df6d96b tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] [instance: aa145a33-41b1-4e39-9642-132aca11fcfe] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:37.497285 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-d96b21e9-25b1-4f86-acb8-ae989df6d96b tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:37.497285 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-d96b21e9-25b1-4f86-acb8-ae989df6d96b tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:37.497285 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-d96b21e9-25b1-4f86-acb8-ae989df6d96b tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:37.497285 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-d96b21e9-25b1-4f86-acb8-ae989df6d96b tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:37.515592 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-d80693fc-8ac3-4d94-bbd1-55f90f365dbd tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:37.516944 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-d80693fc-8ac3-4d94-bbd1-55f90f365dbd tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 598b0e3f-8cf1-451a-80a8-ed7e5dd36984] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:37.526151 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-d80693fc-8ac3-4d94-bbd1-55f90f365dbd tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:37.526644 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-d80693fc-8ac3-4d94-bbd1-55f90f365dbd tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:37.527651 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-d80693fc-8ac3-4d94-bbd1-55f90f365dbd tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:37.528243 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-d80693fc-8ac3-4d94-bbd1-55f90f365dbd tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:37.731681 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-d80693fc-8ac3-4d94-bbd1-55f90f365dbd tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:37.741062 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-d80693fc-8ac3-4d94-bbd1-55f90f365dbd tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:37.742534 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-d80693fc-8ac3-4d94-bbd1-55f90f365dbd tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:37.743769 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-d80693fc-8ac3-4d94-bbd1-55f90f365dbd tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984" status: 200 len: 1751 microversion: 2.20 time: 0.232067 May 26 15:00:37.744322 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 257/539] 10.222.0.81 () {60 vars in 1277 bytes} [Wed May 26 15:00:37 2021] GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984 => generated 1751 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:00:37.782909 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-d96b21e9-25b1-4f86-acb8-ae989df6d96b tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "POST /compute/v2.1/servers/aa145a33-41b1-4e39-9642-132aca11fcfe/action" status: 202 len: 0 microversion: 2.1 time: 0.300969 May 26 15:00:37.783472 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 283/540] 10.222.0.81 () {60 vars in 1278 bytes} [Wed May 26 15:00:37 2021] POST /compute/v2.1/servers/aa145a33-41b1-4e39-9642-132aca11fcfe/action => generated 0 bytes in 302 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 15:00:37.791336 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-246d2eb9-3a56-40dd-8620-77f8304774b5 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:37.791991 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-246d2eb9-3a56-40dd-8620-77f8304774b5 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] [instance: aa145a33-41b1-4e39-9642-132aca11fcfe] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:37.799479 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-246d2eb9-3a56-40dd-8620-77f8304774b5 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:37.799989 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-246d2eb9-3a56-40dd-8620-77f8304774b5 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:37.800776 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-246d2eb9-3a56-40dd-8620-77f8304774b5 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:37.801218 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-246d2eb9-3a56-40dd-8620-77f8304774b5 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:37.904876 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-edf8b2ed-4622-44b4-823a-1c890d7023ae tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:37.905609 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-edf8b2ed-4622-44b4-823a-1c890d7023ae tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] [instance: 4266a63b-9328-4c00-81d2-3583ceb5d080] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:37.916629 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-edf8b2ed-4622-44b4-823a-1c890d7023ae tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:37.917087 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-edf8b2ed-4622-44b4-823a-1c890d7023ae tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:37.917906 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-edf8b2ed-4622-44b4-823a-1c890d7023ae tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:37.918515 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-edf8b2ed-4622-44b4-823a-1c890d7023ae tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:38.022614 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-246d2eb9-3a56-40dd-8620-77f8304774b5 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b167942c895345b186a3eda5c82175b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad2ab2705ca479ab4aaafe7c80de162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:38.033411 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-246d2eb9-3a56-40dd-8620-77f8304774b5 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /compute/v2.1/servers/aa145a33-41b1-4e39-9642-132aca11fcfe" status: 200 len: 1555 microversion: 2.1 time: 0.245524 May 26 15:00:38.033972 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 258/541] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:00:37 2021] GET /compute/v2.1/servers/aa145a33-41b1-4e39-9642-132aca11fcfe => generated 1555 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:00:38.224166 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-f0e37f71-f806-46fe-a28f-a9210c9f81b0 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:38.225529 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-f0e37f71-f806-46fe-a28f-a9210c9f81b0 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] [instance: 8e4e2075-5a0f-4e15-892d-e4b5eb5b8807] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:38.234346 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-f0e37f71-f806-46fe-a28f-a9210c9f81b0 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:38.235416 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-f0e37f71-f806-46fe-a28f-a9210c9f81b0 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:38.236217 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-f0e37f71-f806-46fe-a28f-a9210c9f81b0 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:38.236666 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-f0e37f71-f806-46fe-a28f-a9210c9f81b0 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:38.340681 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-edf8b2ed-4622-44b4-823a-1c890d7023ae tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be4bd5c0f2a400da491bae101b48832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515325707f64d58a28f26451b2c74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:38.352534 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-edf8b2ed-4622-44b4-823a-1c890d7023ae tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /compute/v2.1/servers/4266a63b-9328-4c00-81d2-3583ceb5d080" status: 200 len: 1317 microversion: 2.1 time: 0.454495 May 26 15:00:38.354268 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 284/542] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:00:37 2021] GET /compute/v2.1/servers/4266a63b-9328-4c00-81d2-3583ceb5d080 => generated 1317 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:00:38.454408 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-e2a58c65-1f03-48a1-8554-a66b1252fcec tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:38.455274 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-e2a58c65-1f03-48a1-8554-a66b1252fcec tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] [instance: 990431e1-82cb-42b0-a288-949d79e21762] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:38.463336 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-e2a58c65-1f03-48a1-8554-a66b1252fcec tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:38.463927 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-e2a58c65-1f03-48a1-8554-a66b1252fcec tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:38.465058 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-e2a58c65-1f03-48a1-8554-a66b1252fcec tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:38.465637 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-e2a58c65-1f03-48a1-8554-a66b1252fcec tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:38.467601 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-f0e37f71-f806-46fe-a28f-a9210c9f81b0 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96610ea2bcf84875be6d08859dd0c7b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dffd269c3a344d36b77ebb04d0c412e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:38.476928 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-f0e37f71-f806-46fe-a28f-a9210c9f81b0 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] 10.222.0.81 "GET /compute/v2.1/servers/8e4e2075-5a0f-4e15-892d-e4b5eb5b8807" status: 200 len: 1314 microversion: 2.1 time: 0.256404 May 26 15:00:38.477505 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 259/543] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:00:38 2021] GET /compute/v2.1/servers/8e4e2075-5a0f-4e15-892d-e4b5eb5b8807 => generated 1314 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:00:38.762532 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-df7641da-6e49-436f-8435-8bc62aa64bfa tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:38.763136 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-df7641da-6e49-436f-8435-8bc62aa64bfa tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 598b0e3f-8cf1-451a-80a8-ed7e5dd36984] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:38.771501 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-df7641da-6e49-436f-8435-8bc62aa64bfa tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:38.771957 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-df7641da-6e49-436f-8435-8bc62aa64bfa tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:38.773266 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-df7641da-6e49-436f-8435-8bc62aa64bfa tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:38.773266 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-df7641da-6e49-436f-8435-8bc62aa64bfa tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:38.835072 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-e2a58c65-1f03-48a1-8554-a66b1252fcec tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8604f942d44fec96828cc0b1ae5960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b729993a1944061bb0a708877c95a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:38.845598 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-e2a58c65-1f03-48a1-8554-a66b1252fcec tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] 10.222.0.81 "GET /compute/v2.1/servers/990431e1-82cb-42b0-a288-949d79e21762" status: 200 len: 1515 microversion: 2.1 time: 0.395144 May 26 15:00:38.846283 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 285/544] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:00:38 2021] GET /compute/v2.1/servers/990431e1-82cb-42b0-a288-949d79e21762 => generated 1515 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:00:39.052209 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-f3a162c9-1532-4141-a3a2-f65dbb85a09d tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:39.053130 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-f3a162c9-1532-4141-a3a2-f65dbb85a09d tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] [instance: aa145a33-41b1-4e39-9642-132aca11fcfe] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:39.061119 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-f3a162c9-1532-4141-a3a2-f65dbb85a09d tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:39.061609 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-f3a162c9-1532-4141-a3a2-f65dbb85a09d tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:39.062714 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-f3a162c9-1532-4141-a3a2-f65dbb85a09d tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:39.063632 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-f3a162c9-1532-4141-a3a2-f65dbb85a09d tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:39.144593 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-df7641da-6e49-436f-8435-8bc62aa64bfa tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:39.154591 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-df7641da-6e49-436f-8435-8bc62aa64bfa tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:39.156306 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-df7641da-6e49-436f-8435-8bc62aa64bfa tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:39.157561 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-df7641da-6e49-436f-8435-8bc62aa64bfa tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984" status: 200 len: 1807 microversion: 2.20 time: 0.398902 May 26 15:00:39.158123 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 260/545] 10.222.0.81 () {60 vars in 1277 bytes} [Wed May 26 15:00:38 2021] GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984 => generated 1807 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:00:39.273132 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-f3a162c9-1532-4141-a3a2-f65dbb85a09d tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b167942c895345b186a3eda5c82175b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad2ab2705ca479ab4aaafe7c80de162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:39.282481 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-f3a162c9-1532-4141-a3a2-f65dbb85a09d tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /compute/v2.1/servers/aa145a33-41b1-4e39-9642-132aca11fcfe" status: 200 len: 1555 microversion: 2.1 time: 0.234968 May 26 15:00:39.283053 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 286/546] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:00:39 2021] GET /compute/v2.1/servers/aa145a33-41b1-4e39-9642-132aca11fcfe => generated 1555 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:00:39.371357 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-c8abfd30-e9f2-4ed1-984e-80ccf9e9fc46 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:39.372665 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-c8abfd30-e9f2-4ed1-984e-80ccf9e9fc46 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] [instance: 4266a63b-9328-4c00-81d2-3583ceb5d080] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:39.384259 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-c8abfd30-e9f2-4ed1-984e-80ccf9e9fc46 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:39.384971 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-c8abfd30-e9f2-4ed1-984e-80ccf9e9fc46 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:39.385908 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-c8abfd30-e9f2-4ed1-984e-80ccf9e9fc46 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:39.386620 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-c8abfd30-e9f2-4ed1-984e-80ccf9e9fc46 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:39.494601 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-25d8b240-7362-4d25-8bc6-27e11aaa2630 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:39.495331 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-25d8b240-7362-4d25-8bc6-27e11aaa2630 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] [instance: 8e4e2075-5a0f-4e15-892d-e4b5eb5b8807] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:39.503088 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-25d8b240-7362-4d25-8bc6-27e11aaa2630 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:39.503540 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-25d8b240-7362-4d25-8bc6-27e11aaa2630 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:39.504314 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-25d8b240-7362-4d25-8bc6-27e11aaa2630 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:39.504751 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-25d8b240-7362-4d25-8bc6-27e11aaa2630 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:39.728271 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-c8abfd30-e9f2-4ed1-984e-80ccf9e9fc46 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be4bd5c0f2a400da491bae101b48832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515325707f64d58a28f26451b2c74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:39.737313 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-c8abfd30-e9f2-4ed1-984e-80ccf9e9fc46 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /compute/v2.1/servers/4266a63b-9328-4c00-81d2-3583ceb5d080" status: 200 len: 1317 microversion: 2.1 time: 0.370175 May 26 15:00:39.737929 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 261/547] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:00:39 2021] GET /compute/v2.1/servers/4266a63b-9328-4c00-81d2-3583ceb5d080 => generated 1317 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:00:39.824307 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-25d8b240-7362-4d25-8bc6-27e11aaa2630 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96610ea2bcf84875be6d08859dd0c7b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dffd269c3a344d36b77ebb04d0c412e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:39.833002 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-25d8b240-7362-4d25-8bc6-27e11aaa2630 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] 10.222.0.81 "GET /compute/v2.1/servers/8e4e2075-5a0f-4e15-892d-e4b5eb5b8807" status: 200 len: 1314 microversion: 2.1 time: 0.341628 May 26 15:00:39.834072 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 287/548] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:00:39 2021] GET /compute/v2.1/servers/8e4e2075-5a0f-4e15-892d-e4b5eb5b8807 => generated 1314 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:00:39.863125 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-32a25a32-e72d-47ef-b41e-b69e59806c02 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:39.864184 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-32a25a32-e72d-47ef-b41e-b69e59806c02 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] [instance: 990431e1-82cb-42b0-a288-949d79e21762] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:39.871486 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-32a25a32-e72d-47ef-b41e-b69e59806c02 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:39.872042 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-32a25a32-e72d-47ef-b41e-b69e59806c02 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:39.872890 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-32a25a32-e72d-47ef-b41e-b69e59806c02 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:39.873406 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-32a25a32-e72d-47ef-b41e-b69e59806c02 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:40.096606 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-32a25a32-e72d-47ef-b41e-b69e59806c02 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8604f942d44fec96828cc0b1ae5960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b729993a1944061bb0a708877c95a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:40.104971 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-32a25a32-e72d-47ef-b41e-b69e59806c02 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] 10.222.0.81 "GET /compute/v2.1/servers/990431e1-82cb-42b0-a288-949d79e21762" status: 200 len: 1515 microversion: 2.1 time: 0.246388 May 26 15:00:40.105754 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 262/549] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:00:39 2021] GET /compute/v2.1/servers/990431e1-82cb-42b0-a288-949d79e21762 => generated 1515 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:00:40.176912 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-d41c21ef-48e2-4992-a236-cb64793af9c7 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:40.177556 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-d41c21ef-48e2-4992-a236-cb64793af9c7 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 598b0e3f-8cf1-451a-80a8-ed7e5dd36984] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:40.185028 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-d41c21ef-48e2-4992-a236-cb64793af9c7 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:40.185489 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-d41c21ef-48e2-4992-a236-cb64793af9c7 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:40.186723 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-d41c21ef-48e2-4992-a236-cb64793af9c7 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:40.187165 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-d41c21ef-48e2-4992-a236-cb64793af9c7 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:40.312107 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-ea11f5b4-8bfa-4bf4-8a3a-3c42ccfcd17e tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:40.312770 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-ea11f5b4-8bfa-4bf4-8a3a-3c42ccfcd17e tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] [instance: aa145a33-41b1-4e39-9642-132aca11fcfe] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:40.324262 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-ea11f5b4-8bfa-4bf4-8a3a-3c42ccfcd17e tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:40.324711 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-ea11f5b4-8bfa-4bf4-8a3a-3c42ccfcd17e tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:40.325645 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-ea11f5b4-8bfa-4bf4-8a3a-3c42ccfcd17e tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:40.326087 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-ea11f5b4-8bfa-4bf4-8a3a-3c42ccfcd17e tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:40.567906 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-ea11f5b4-8bfa-4bf4-8a3a-3c42ccfcd17e tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b167942c895345b186a3eda5c82175b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad2ab2705ca479ab4aaafe7c80de162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:40.581381 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-ea11f5b4-8bfa-4bf4-8a3a-3c42ccfcd17e tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /compute/v2.1/servers/aa145a33-41b1-4e39-9642-132aca11fcfe" status: 200 len: 1555 microversion: 2.1 time: 0.285525 May 26 15:00:40.582219 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 263/550] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:00:40 2021] GET /compute/v2.1/servers/aa145a33-41b1-4e39-9642-132aca11fcfe => generated 1555 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:00:40.597304 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [req-10d0e6a1-5ed6-40e3-b4ac-974ab6205533 req-947dc799-87b5-424b-b5c2-78159007ea6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4266a63b-9328-4c00-81d2-3583ceb5d080", "name": "network-vif-plugged", "status": "completed", "tag": "7b7c8c36-6397-47d6-91bb-4f1db62a6e1a"}]} {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:00:40.599219 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 15:00:40.599219 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: warnings.warn(msg) May 26 15:00:40.611808 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [req-10d0e6a1-5ed6-40e3-b4ac-974ab6205533 req-947dc799-87b5-424b-b5c2-78159007ea6b service nova] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:40.611808 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [req-10d0e6a1-5ed6-40e3-b4ac-974ab6205533 req-947dc799-87b5-424b-b5c2-78159007ea6b service nova] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:40.627820 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.compute.server_external_events [req-10d0e6a1-5ed6-40e3-b4ac-974ab6205533 req-947dc799-87b5-424b-b5c2-78159007ea6b service nova] Creating event network-vif-plugged:7b7c8c36-6397-47d6-91bb-4f1db62a6e1a for instance 4266a63b-9328-4c00-81d2-3583ceb5d080 on hv-cinder-78414 May 26 15:00:40.639038 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [req-10d0e6a1-5ed6-40e3-b4ac-974ab6205533 req-947dc799-87b5-424b-b5c2-78159007ea6b service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039825 May 26 15:00:40.639038 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 264/551] 10.222.0.81 () {64 vars in 1318 bytes} [Wed May 26 15:00:40 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:00:40.677016 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [req-87987b1e-2a1b-41cd-b086-c88c5bb71d92 req-00a1f1f0-bab1-4f69-a26f-77fc6c377ba7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "990431e1-82cb-42b0-a288-949d79e21762", "name": "network-vif-deleted", "tag": "6140c9e0-a80c-4dc2-a884-ac0e5dbfdf15"}]} {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:00:40.678655 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 15:00:40.678655 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: warnings.warn(msg) May 26 15:00:40.694040 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [req-87987b1e-2a1b-41cd-b086-c88c5bb71d92 req-00a1f1f0-bab1-4f69-a26f-77fc6c377ba7 service nova] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:40.694785 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [req-87987b1e-2a1b-41cd-b086-c88c5bb71d92 req-00a1f1f0-bab1-4f69-a26f-77fc6c377ba7 service nova] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:40.726390 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.compute.server_external_events [req-87987b1e-2a1b-41cd-b086-c88c5bb71d92 req-00a1f1f0-bab1-4f69-a26f-77fc6c377ba7 service nova] Creating event network-vif-deleted:6140c9e0-a80c-4dc2-a884-ac0e5dbfdf15 for instance 990431e1-82cb-42b0-a288-949d79e21762 on hv-cinder-78414 May 26 15:00:40.744175 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [req-87987b1e-2a1b-41cd-b086-c88c5bb71d92 req-00a1f1f0-bab1-4f69-a26f-77fc6c377ba7 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070273 May 26 15:00:40.745229 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 265/552] 10.222.0.81 () {64 vars in 1318 bytes} [Wed May 26 15:00:40 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 15:00:40.757195 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-89575392-3d98-4a7a-bc13-5544c9cc6b32 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:40.758028 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-89575392-3d98-4a7a-bc13-5544c9cc6b32 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] [instance: 4266a63b-9328-4c00-81d2-3583ceb5d080] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:40.774058 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-89575392-3d98-4a7a-bc13-5544c9cc6b32 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:40.776247 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-89575392-3d98-4a7a-bc13-5544c9cc6b32 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:40.777583 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-89575392-3d98-4a7a-bc13-5544c9cc6b32 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:40.778478 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-89575392-3d98-4a7a-bc13-5544c9cc6b32 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:40.838654 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-d41c21ef-48e2-4992-a236-cb64793af9c7 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:40.869982 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-d41c21ef-48e2-4992-a236-cb64793af9c7 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:40.877464 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-d41c21ef-48e2-4992-a236-cb64793af9c7 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:40.879319 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-d41c21ef-48e2-4992-a236-cb64793af9c7 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984" status: 200 len: 1807 microversion: 2.20 time: 0.707115 May 26 15:00:40.894456 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 288/553] 10.222.0.81 () {60 vars in 1277 bytes} [Wed May 26 15:00:40 2021] GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984 => generated 1807 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:00:40.910047 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-8d4c9138-3fea-4035-bf38-58f23a394455 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:40.916651 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-8d4c9138-3fea-4035-bf38-58f23a394455 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] [instance: 8e4e2075-5a0f-4e15-892d-e4b5eb5b8807] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:40.919990 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-8d4c9138-3fea-4035-bf38-58f23a394455 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:40.920675 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-8d4c9138-3fea-4035-bf38-58f23a394455 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:40.921745 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-8d4c9138-3fea-4035-bf38-58f23a394455 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:40.922746 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-8d4c9138-3fea-4035-bf38-58f23a394455 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:41.199561 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-89575392-3d98-4a7a-bc13-5544c9cc6b32 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be4bd5c0f2a400da491bae101b48832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515325707f64d58a28f26451b2c74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:41.210342 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-8d4c9138-3fea-4035-bf38-58f23a394455 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96610ea2bcf84875be6d08859dd0c7b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dffd269c3a344d36b77ebb04d0c412e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:41.215621 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-89575392-3d98-4a7a-bc13-5544c9cc6b32 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /compute/v2.1/servers/4266a63b-9328-4c00-81d2-3583ceb5d080" status: 200 len: 1317 microversion: 2.1 time: 0.464310 May 26 15:00:41.217372 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 266/554] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:00:40 2021] GET /compute/v2.1/servers/4266a63b-9328-4c00-81d2-3583ceb5d080 => generated 1317 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:00:41.222540 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-11229648-eec8-466f-9ac9-0c2e29058600 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:41.223315 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-11229648-eec8-466f-9ac9-0c2e29058600 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] [instance: 990431e1-82cb-42b0-a288-949d79e21762] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:41.223612 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-8d4c9138-3fea-4035-bf38-58f23a394455 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] 10.222.0.81 "GET /compute/v2.1/servers/8e4e2075-5a0f-4e15-892d-e4b5eb5b8807" status: 200 len: 1314 microversion: 2.1 time: 0.326850 May 26 15:00:41.232960 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 289/555] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:00:40 2021] GET /compute/v2.1/servers/8e4e2075-5a0f-4e15-892d-e4b5eb5b8807 => generated 1314 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:00:41.241032 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-11229648-eec8-466f-9ac9-0c2e29058600 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:41.241490 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-11229648-eec8-466f-9ac9-0c2e29058600 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:41.242561 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-11229648-eec8-466f-9ac9-0c2e29058600 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:41.243044 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-11229648-eec8-466f-9ac9-0c2e29058600 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:41.385894 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-11229648-eec8-466f-9ac9-0c2e29058600 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8604f942d44fec96828cc0b1ae5960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b729993a1944061bb0a708877c95a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:41.395918 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-11229648-eec8-466f-9ac9-0c2e29058600 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] 10.222.0.81 "GET /compute/v2.1/servers/990431e1-82cb-42b0-a288-949d79e21762" status: 200 len: 1304 microversion: 2.1 time: 0.177407 May 26 15:00:41.396815 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 267/556] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:00:41 2021] GET /compute/v2.1/servers/990431e1-82cb-42b0-a288-949d79e21762 => generated 1304 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:00:41.599697 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-3e9584a9-86e3-4631-a1f4-e8e2b21bd7d1 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:41.600237 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-3e9584a9-86e3-4631-a1f4-e8e2b21bd7d1 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] [instance: aa145a33-41b1-4e39-9642-132aca11fcfe] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:41.607608 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-3e9584a9-86e3-4631-a1f4-e8e2b21bd7d1 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:41.608082 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-3e9584a9-86e3-4631-a1f4-e8e2b21bd7d1 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:41.608868 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-3e9584a9-86e3-4631-a1f4-e8e2b21bd7d1 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:41.609313 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-3e9584a9-86e3-4631-a1f4-e8e2b21bd7d1 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:41.818088 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-3e9584a9-86e3-4631-a1f4-e8e2b21bd7d1 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b167942c895345b186a3eda5c82175b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad2ab2705ca479ab4aaafe7c80de162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:41.826966 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-3e9584a9-86e3-4631-a1f4-e8e2b21bd7d1 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /compute/v2.1/servers/aa145a33-41b1-4e39-9642-132aca11fcfe" status: 200 len: 1555 microversion: 2.1 time: 0.230882 May 26 15:00:41.827581 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 290/557] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:00:41 2021] GET /compute/v2.1/servers/aa145a33-41b1-4e39-9642-132aca11fcfe => generated 1555 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:00:41.898203 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-ef183a0d-7767-47d1-ac77-07ec5dbe41bd tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:41.898806 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-ef183a0d-7767-47d1-ac77-07ec5dbe41bd tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 598b0e3f-8cf1-451a-80a8-ed7e5dd36984] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:41.908679 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-ef183a0d-7767-47d1-ac77-07ec5dbe41bd tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:41.909251 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-ef183a0d-7767-47d1-ac77-07ec5dbe41bd tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:41.910248 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-ef183a0d-7767-47d1-ac77-07ec5dbe41bd tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:41.910696 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-ef183a0d-7767-47d1-ac77-07ec5dbe41bd tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:42.116926 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-ef183a0d-7767-47d1-ac77-07ec5dbe41bd tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:42.127502 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-ef183a0d-7767-47d1-ac77-07ec5dbe41bd tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:42.129050 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-ef183a0d-7767-47d1-ac77-07ec5dbe41bd tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:42.130249 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-ef183a0d-7767-47d1-ac77-07ec5dbe41bd tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984" status: 200 len: 1807 microversion: 2.20 time: 0.236074 May 26 15:00:42.130988 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 268/558] 10.222.0.81 () {60 vars in 1277 bytes} [Wed May 26 15:00:41 2021] GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984 => generated 1807 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:00:42.232252 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-d7dbb782-382e-4638-8d98-82b054bb46ae tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:42.233553 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-d7dbb782-382e-4638-8d98-82b054bb46ae tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] [instance: 4266a63b-9328-4c00-81d2-3583ceb5d080] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:42.243347 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-b0fc324c-7ab4-4897-aa7b-041d928d0cfb tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:42.244034 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-b0fc324c-7ab4-4897-aa7b-041d928d0cfb tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] [instance: 8e4e2075-5a0f-4e15-892d-e4b5eb5b8807] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:42.248984 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-d7dbb782-382e-4638-8d98-82b054bb46ae tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:42.249450 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-d7dbb782-382e-4638-8d98-82b054bb46ae tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:42.250866 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-d7dbb782-382e-4638-8d98-82b054bb46ae tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:42.251305 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-d7dbb782-382e-4638-8d98-82b054bb46ae tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:42.254332 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-b0fc324c-7ab4-4897-aa7b-041d928d0cfb tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:42.257409 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-b0fc324c-7ab4-4897-aa7b-041d928d0cfb tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:42.257409 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-b0fc324c-7ab4-4897-aa7b-041d928d0cfb tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:42.257409 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-b0fc324c-7ab4-4897-aa7b-041d928d0cfb tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:42.478831 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-d7dbb782-382e-4638-8d98-82b054bb46ae tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be4bd5c0f2a400da491bae101b48832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515325707f64d58a28f26451b2c74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:42.488559 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-d7dbb782-382e-4638-8d98-82b054bb46ae tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /compute/v2.1/servers/4266a63b-9328-4c00-81d2-3583ceb5d080" status: 200 len: 1317 microversion: 2.1 time: 0.260042 May 26 15:00:42.489503 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 291/559] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:00:42 2021] GET /compute/v2.1/servers/4266a63b-9328-4c00-81d2-3583ceb5d080 => generated 1317 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:00:42.492873 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-b0fc324c-7ab4-4897-aa7b-041d928d0cfb tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96610ea2bcf84875be6d08859dd0c7b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dffd269c3a344d36b77ebb04d0c412e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:42.493845 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-ecd05031-1aac-4bb1-97be-12f69ecc8b7b tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:42.494455 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-ecd05031-1aac-4bb1-97be-12f69ecc8b7b tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] [instance: 990431e1-82cb-42b0-a288-949d79e21762] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:42.502045 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-ecd05031-1aac-4bb1-97be-12f69ecc8b7b tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:42.502462 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-ecd05031-1aac-4bb1-97be-12f69ecc8b7b tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:42.503252 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-ecd05031-1aac-4bb1-97be-12f69ecc8b7b tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:42.503374 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-b0fc324c-7ab4-4897-aa7b-041d928d0cfb tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] 10.222.0.81 "GET /compute/v2.1/servers/8e4e2075-5a0f-4e15-892d-e4b5eb5b8807" status: 200 len: 1314 microversion: 2.1 time: 0.265995 May 26 15:00:42.503702 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-ecd05031-1aac-4bb1-97be-12f69ecc8b7b tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:42.503928 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 269/560] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:00:42 2021] GET /compute/v2.1/servers/8e4e2075-5a0f-4e15-892d-e4b5eb5b8807 => generated 1314 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:00:42.684051 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [req-a03562ef-e1b4-4773-b684-733a55adc070 req-669a8faf-8de4-436f-92fe-3f03e657a435 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e4e2075-5a0f-4e15-892d-e4b5eb5b8807", "name": "network-vif-plugged", "status": "completed", "tag": "e2b86960-bb59-4f27-9951-ec442358a17d"}]} {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:00:42.685369 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-ecd05031-1aac-4bb1-97be-12f69ecc8b7b tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8604f942d44fec96828cc0b1ae5960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b729993a1944061bb0a708877c95a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:42.686292 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 15:00:42.686292 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: warnings.warn(msg) May 26 15:00:42.695510 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [req-a03562ef-e1b4-4773-b684-733a55adc070 req-669a8faf-8de4-436f-92fe-3f03e657a435 service nova] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:42.696083 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [req-a03562ef-e1b4-4773-b684-733a55adc070 req-669a8faf-8de4-436f-92fe-3f03e657a435 service nova] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:42.700125 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-ecd05031-1aac-4bb1-97be-12f69ecc8b7b tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] 10.222.0.81 "GET /compute/v2.1/servers/990431e1-82cb-42b0-a288-949d79e21762" status: 200 len: 1304 microversion: 2.1 time: 0.209537 May 26 15:00:42.700818 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 292/561] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:00:42 2021] GET /compute/v2.1/servers/990431e1-82cb-42b0-a288-949d79e21762 => generated 1304 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:00:42.714400 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.compute.server_external_events [req-a03562ef-e1b4-4773-b684-733a55adc070 req-669a8faf-8de4-436f-92fe-3f03e657a435 service nova] Creating event network-vif-plugged:e2b86960-bb59-4f27-9951-ec442358a17d for instance 8e4e2075-5a0f-4e15-892d-e4b5eb5b8807 on hv-cinder-78414 May 26 15:00:42.719718 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [req-a03562ef-e1b4-4773-b684-733a55adc070 req-669a8faf-8de4-436f-92fe-3f03e657a435 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039821 May 26 15:00:42.720319 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 270/562] 10.222.0.81 () {64 vars in 1318 bytes} [Wed May 26 15:00:42 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:00:42.845414 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-8689f709-89ac-4618-9c77-7c0c92cda100 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:42.846007 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-8689f709-89ac-4618-9c77-7c0c92cda100 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] [instance: aa145a33-41b1-4e39-9642-132aca11fcfe] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:42.853661 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-8689f709-89ac-4618-9c77-7c0c92cda100 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:42.854120 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-8689f709-89ac-4618-9c77-7c0c92cda100 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:42.854905 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-8689f709-89ac-4618-9c77-7c0c92cda100 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:42.855350 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-8689f709-89ac-4618-9c77-7c0c92cda100 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:43.065930 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-8689f709-89ac-4618-9c77-7c0c92cda100 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b167942c895345b186a3eda5c82175b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad2ab2705ca479ab4aaafe7c80de162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:43.075030 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-8689f709-89ac-4618-9c77-7c0c92cda100 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /compute/v2.1/servers/aa145a33-41b1-4e39-9642-132aca11fcfe" status: 200 len: 1555 microversion: 2.1 time: 0.234533 May 26 15:00:43.075609 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 293/563] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:00:42 2021] GET /compute/v2.1/servers/aa145a33-41b1-4e39-9642-132aca11fcfe => generated 1555 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:00:43.150263 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-500b0950-e865-48af-a259-dc4aaec5f9e4 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:43.151235 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-500b0950-e865-48af-a259-dc4aaec5f9e4 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 598b0e3f-8cf1-451a-80a8-ed7e5dd36984] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:43.160700 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-500b0950-e865-48af-a259-dc4aaec5f9e4 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:43.161192 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-500b0950-e865-48af-a259-dc4aaec5f9e4 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:43.162097 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-500b0950-e865-48af-a259-dc4aaec5f9e4 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:43.162675 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-500b0950-e865-48af-a259-dc4aaec5f9e4 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:43.376221 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-500b0950-e865-48af-a259-dc4aaec5f9e4 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:43.386222 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-500b0950-e865-48af-a259-dc4aaec5f9e4 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:43.387830 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-500b0950-e865-48af-a259-dc4aaec5f9e4 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:43.389003 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-500b0950-e865-48af-a259-dc4aaec5f9e4 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984" status: 200 len: 1807 microversion: 2.20 time: 0.243355 May 26 15:00:43.400018 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 271/564] 10.222.0.81 () {60 vars in 1277 bytes} [Wed May 26 15:00:43 2021] GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984 => generated 1807 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:00:43.506435 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-a3b38b0d-8242-48dd-acd2-4a18fd855c77 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:43.507166 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-a3b38b0d-8242-48dd-acd2-4a18fd855c77 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] [instance: 4266a63b-9328-4c00-81d2-3583ceb5d080] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:43.515050 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-a3b38b0d-8242-48dd-acd2-4a18fd855c77 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:43.515572 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-a3b38b0d-8242-48dd-acd2-4a18fd855c77 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:43.516503 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-a3b38b0d-8242-48dd-acd2-4a18fd855c77 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:43.517142 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-a3b38b0d-8242-48dd-acd2-4a18fd855c77 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:43.520329 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-a0eef6c4-4a87-4a8c-93d6-d6f570a55fd4 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:43.521017 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-a0eef6c4-4a87-4a8c-93d6-d6f570a55fd4 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] [instance: 8e4e2075-5a0f-4e15-892d-e4b5eb5b8807] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:43.531118 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-a0eef6c4-4a87-4a8c-93d6-d6f570a55fd4 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:43.531984 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-a0eef6c4-4a87-4a8c-93d6-d6f570a55fd4 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:43.532925 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-a0eef6c4-4a87-4a8c-93d6-d6f570a55fd4 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:43.533438 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-a0eef6c4-4a87-4a8c-93d6-d6f570a55fd4 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:43.737207 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-a3b38b0d-8242-48dd-acd2-4a18fd855c77 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be4bd5c0f2a400da491bae101b48832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515325707f64d58a28f26451b2c74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:43.745881 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-a3b38b0d-8242-48dd-acd2-4a18fd855c77 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /compute/v2.1/servers/4266a63b-9328-4c00-81d2-3583ceb5d080" status: 200 len: 1317 microversion: 2.1 time: 0.243181 May 26 15:00:43.746042 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-a0eef6c4-4a87-4a8c-93d6-d6f570a55fd4 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96610ea2bcf84875be6d08859dd0c7b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dffd269c3a344d36b77ebb04d0c412e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:43.746679 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 294/565] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:00:43 2021] GET /compute/v2.1/servers/4266a63b-9328-4c00-81d2-3583ceb5d080 => generated 1317 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:00:43.750748 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-e0f375df-2fd2-4e15-804d-58460d2ee039 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:43.751550 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-e0f375df-2fd2-4e15-804d-58460d2ee039 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] [instance: 990431e1-82cb-42b0-a288-949d79e21762] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:43.754898 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-a0eef6c4-4a87-4a8c-93d6-d6f570a55fd4 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] 10.222.0.81 "GET /compute/v2.1/servers/8e4e2075-5a0f-4e15-892d-e4b5eb5b8807" status: 200 len: 1314 microversion: 2.1 time: 0.238374 May 26 15:00:43.755474 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 272/566] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:00:43 2021] GET /compute/v2.1/servers/8e4e2075-5a0f-4e15-892d-e4b5eb5b8807 => generated 1314 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:00:43.758877 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-e0f375df-2fd2-4e15-804d-58460d2ee039 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:43.759368 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-e0f375df-2fd2-4e15-804d-58460d2ee039 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:43.760151 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-e0f375df-2fd2-4e15-804d-58460d2ee039 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:43.760610 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-e0f375df-2fd2-4e15-804d-58460d2ee039 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:43.876499 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-e0f375df-2fd2-4e15-804d-58460d2ee039 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8604f942d44fec96828cc0b1ae5960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b729993a1944061bb0a708877c95a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:43.885515 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-e0f375df-2fd2-4e15-804d-58460d2ee039 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] 10.222.0.81 "GET /compute/v2.1/servers/990431e1-82cb-42b0-a288-949d79e21762" status: 200 len: 1304 microversion: 2.1 time: 0.137996 May 26 15:00:43.886117 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 295/567] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:00:43 2021] GET /compute/v2.1/servers/990431e1-82cb-42b0-a288-949d79e21762 => generated 1304 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:00:44.093036 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-329273e7-9459-4199-b5ea-a6e61fce7202 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:44.093601 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-329273e7-9459-4199-b5ea-a6e61fce7202 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] [instance: aa145a33-41b1-4e39-9642-132aca11fcfe] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:44.102199 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-329273e7-9459-4199-b5ea-a6e61fce7202 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:44.102660 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-329273e7-9459-4199-b5ea-a6e61fce7202 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:44.103452 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-329273e7-9459-4199-b5ea-a6e61fce7202 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:44.103916 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-329273e7-9459-4199-b5ea-a6e61fce7202 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:44.310693 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-329273e7-9459-4199-b5ea-a6e61fce7202 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b167942c895345b186a3eda5c82175b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad2ab2705ca479ab4aaafe7c80de162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:44.319820 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-329273e7-9459-4199-b5ea-a6e61fce7202 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /compute/v2.1/servers/aa145a33-41b1-4e39-9642-132aca11fcfe" status: 200 len: 1555 microversion: 2.1 time: 0.230598 May 26 15:00:44.320393 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 273/568] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:00:44 2021] GET /compute/v2.1/servers/aa145a33-41b1-4e39-9642-132aca11fcfe => generated 1555 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:00:44.408453 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-8a5ffc49-0172-4bbd-a6cd-bc500727c503 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:44.409069 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-8a5ffc49-0172-4bbd-a6cd-bc500727c503 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 598b0e3f-8cf1-451a-80a8-ed7e5dd36984] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:44.416359 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-8a5ffc49-0172-4bbd-a6cd-bc500727c503 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:44.416816 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-8a5ffc49-0172-4bbd-a6cd-bc500727c503 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:44.417636 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-8a5ffc49-0172-4bbd-a6cd-bc500727c503 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:44.418071 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-8a5ffc49-0172-4bbd-a6cd-bc500727c503 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:44.629646 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-8a5ffc49-0172-4bbd-a6cd-bc500727c503 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:44.643044 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-8a5ffc49-0172-4bbd-a6cd-bc500727c503 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:44.644593 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-8a5ffc49-0172-4bbd-a6cd-bc500727c503 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:44.645799 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-8a5ffc49-0172-4bbd-a6cd-bc500727c503 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984" status: 200 len: 1807 microversion: 2.20 time: 0.241183 May 26 15:00:44.646504 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 296/569] 10.222.0.81 () {60 vars in 1277 bytes} [Wed May 26 15:00:44 2021] GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984 => generated 1807 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:00:44.762892 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-d6633d1d-19eb-4c5f-91b1-2049b7403bf0 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:44.763791 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-d6633d1d-19eb-4c5f-91b1-2049b7403bf0 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] [instance: 4266a63b-9328-4c00-81d2-3583ceb5d080] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:44.772001 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-158b51a9-d477-4b44-bae5-56f83870ad8e tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:44.772618 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-158b51a9-d477-4b44-bae5-56f83870ad8e tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] [instance: 8e4e2075-5a0f-4e15-892d-e4b5eb5b8807] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:44.773690 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-d6633d1d-19eb-4c5f-91b1-2049b7403bf0 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:44.774330 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-d6633d1d-19eb-4c5f-91b1-2049b7403bf0 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:44.775281 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-d6633d1d-19eb-4c5f-91b1-2049b7403bf0 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:44.776160 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-d6633d1d-19eb-4c5f-91b1-2049b7403bf0 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:44.780203 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-158b51a9-d477-4b44-bae5-56f83870ad8e tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:44.780662 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-158b51a9-d477-4b44-bae5-56f83870ad8e tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:44.781480 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-158b51a9-d477-4b44-bae5-56f83870ad8e tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:44.781948 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-158b51a9-d477-4b44-bae5-56f83870ad8e tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:44.988343 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-158b51a9-d477-4b44-bae5-56f83870ad8e tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96610ea2bcf84875be6d08859dd0c7b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dffd269c3a344d36b77ebb04d0c412e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:44.989992 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-d6633d1d-19eb-4c5f-91b1-2049b7403bf0 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be4bd5c0f2a400da491bae101b48832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515325707f64d58a28f26451b2c74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:44.997827 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-158b51a9-d477-4b44-bae5-56f83870ad8e tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] 10.222.0.81 "GET /compute/v2.1/servers/8e4e2075-5a0f-4e15-892d-e4b5eb5b8807" status: 200 len: 1314 microversion: 2.1 time: 0.229244 May 26 15:00:44.998607 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 297/570] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:00:44 2021] GET /compute/v2.1/servers/8e4e2075-5a0f-4e15-892d-e4b5eb5b8807 => generated 1314 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:00:44.998814 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-d6633d1d-19eb-4c5f-91b1-2049b7403bf0 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /compute/v2.1/servers/4266a63b-9328-4c00-81d2-3583ceb5d080" status: 200 len: 1317 microversion: 2.1 time: 0.239488 May 26 15:00:44.999811 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 274/571] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:00:44 2021] GET /compute/v2.1/servers/4266a63b-9328-4c00-81d2-3583ceb5d080 => generated 1317 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:00:45.013315 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-78d5d218-0507-4cbc-8ff8-bebd305b638b tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:45.014190 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-78d5d218-0507-4cbc-8ff8-bebd305b638b tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] [instance: 990431e1-82cb-42b0-a288-949d79e21762] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:45.023236 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-78d5d218-0507-4cbc-8ff8-bebd305b638b tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:45.026111 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-78d5d218-0507-4cbc-8ff8-bebd305b638b tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:45.026111 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-78d5d218-0507-4cbc-8ff8-bebd305b638b tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:45.026111 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-78d5d218-0507-4cbc-8ff8-bebd305b638b tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:45.141892 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-78d5d218-0507-4cbc-8ff8-bebd305b638b tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8604f942d44fec96828cc0b1ae5960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b729993a1944061bb0a708877c95a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:45.150411 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-78d5d218-0507-4cbc-8ff8-bebd305b638b tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] 10.222.0.81 "GET /compute/v2.1/servers/990431e1-82cb-42b0-a288-949d79e21762" status: 200 len: 1304 microversion: 2.1 time: 0.140939 May 26 15:00:45.151273 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 298/572] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:00:44 2021] GET /compute/v2.1/servers/990431e1-82cb-42b0-a288-949d79e21762 => generated 1304 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:00:45.337428 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-20613fc7-2b04-4b73-bf4f-ceb9cee7e963 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:45.338054 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-20613fc7-2b04-4b73-bf4f-ceb9cee7e963 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] [instance: aa145a33-41b1-4e39-9642-132aca11fcfe] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:45.346018 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-20613fc7-2b04-4b73-bf4f-ceb9cee7e963 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:45.346492 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-20613fc7-2b04-4b73-bf4f-ceb9cee7e963 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:45.347275 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-20613fc7-2b04-4b73-bf4f-ceb9cee7e963 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:45.347716 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-20613fc7-2b04-4b73-bf4f-ceb9cee7e963 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:45.550924 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-20613fc7-2b04-4b73-bf4f-ceb9cee7e963 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b167942c895345b186a3eda5c82175b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad2ab2705ca479ab4aaafe7c80de162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:45.559843 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-20613fc7-2b04-4b73-bf4f-ceb9cee7e963 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /compute/v2.1/servers/aa145a33-41b1-4e39-9642-132aca11fcfe" status: 200 len: 1555 microversion: 2.1 time: 0.226116 May 26 15:00:45.560411 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 275/573] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:00:45 2021] GET /compute/v2.1/servers/aa145a33-41b1-4e39-9642-132aca11fcfe => generated 1555 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:00:45.664208 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-15551c84-c177-4bdf-bfa0-f775ac9b7a17 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:45.664830 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-15551c84-c177-4bdf-bfa0-f775ac9b7a17 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 598b0e3f-8cf1-451a-80a8-ed7e5dd36984] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:45.672524 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-15551c84-c177-4bdf-bfa0-f775ac9b7a17 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:45.673171 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-15551c84-c177-4bdf-bfa0-f775ac9b7a17 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:45.673998 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-15551c84-c177-4bdf-bfa0-f775ac9b7a17 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:45.674439 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-15551c84-c177-4bdf-bfa0-f775ac9b7a17 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:45.886405 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-15551c84-c177-4bdf-bfa0-f775ac9b7a17 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:45.897110 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-15551c84-c177-4bdf-bfa0-f775ac9b7a17 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:45.898674 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-15551c84-c177-4bdf-bfa0-f775ac9b7a17 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:45.899877 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-15551c84-c177-4bdf-bfa0-f775ac9b7a17 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984" status: 200 len: 1807 microversion: 2.20 time: 0.239686 May 26 15:00:45.900466 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 299/574] 10.222.0.81 () {60 vars in 1277 bytes} [Wed May 26 15:00:45 2021] GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984 => generated 1807 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:00:46.015426 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-3d2392be-d305-4097-9d8c-10a7b2dc1c1b tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:46.016676 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-3d2392be-d305-4097-9d8c-10a7b2dc1c1b tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] [instance: 8e4e2075-5a0f-4e15-892d-e4b5eb5b8807] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:46.017125 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-e99e712d-caf8-4a2e-beba-cbc80a2a8b09 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:46.017998 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-e99e712d-caf8-4a2e-beba-cbc80a2a8b09 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] [instance: 4266a63b-9328-4c00-81d2-3583ceb5d080] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:46.025913 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-e99e712d-caf8-4a2e-beba-cbc80a2a8b09 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:46.026483 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-e99e712d-caf8-4a2e-beba-cbc80a2a8b09 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:46.027356 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-e99e712d-caf8-4a2e-beba-cbc80a2a8b09 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:46.027878 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-e99e712d-caf8-4a2e-beba-cbc80a2a8b09 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:46.028114 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-3d2392be-d305-4097-9d8c-10a7b2dc1c1b tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:46.028575 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-3d2392be-d305-4097-9d8c-10a7b2dc1c1b tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:46.029367 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-3d2392be-d305-4097-9d8c-10a7b2dc1c1b tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:46.029836 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-3d2392be-d305-4097-9d8c-10a7b2dc1c1b tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:46.241825 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-e99e712d-caf8-4a2e-beba-cbc80a2a8b09 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be4bd5c0f2a400da491bae101b48832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515325707f64d58a28f26451b2c74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:46.250623 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-e99e712d-caf8-4a2e-beba-cbc80a2a8b09 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /compute/v2.1/servers/4266a63b-9328-4c00-81d2-3583ceb5d080" status: 200 len: 1317 microversion: 2.1 time: 0.237749 May 26 15:00:46.251509 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 300/575] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:00:46 2021] GET /compute/v2.1/servers/4266a63b-9328-4c00-81d2-3583ceb5d080 => generated 1317 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:00:46.256551 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-2d5f8a28-482b-4fea-94a8-c83d9c68c467 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:46.257009 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-2d5f8a28-482b-4fea-94a8-c83d9c68c467 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] [instance: 990431e1-82cb-42b0-a288-949d79e21762] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:46.264306 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-2d5f8a28-482b-4fea-94a8-c83d9c68c467 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:46.264767 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-2d5f8a28-482b-4fea-94a8-c83d9c68c467 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:46.265697 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-2d5f8a28-482b-4fea-94a8-c83d9c68c467 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:46.266786 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-2d5f8a28-482b-4fea-94a8-c83d9c68c467 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:46.357161 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-3d2392be-d305-4097-9d8c-10a7b2dc1c1b tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96610ea2bcf84875be6d08859dd0c7b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dffd269c3a344d36b77ebb04d0c412e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:46.373712 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-3d2392be-d305-4097-9d8c-10a7b2dc1c1b tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] 10.222.0.81 "GET /compute/v2.1/servers/8e4e2075-5a0f-4e15-892d-e4b5eb5b8807" status: 200 len: 1314 microversion: 2.1 time: 0.362172 May 26 15:00:46.374690 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 276/576] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:00:46 2021] GET /compute/v2.1/servers/8e4e2075-5a0f-4e15-892d-e4b5eb5b8807 => generated 1314 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:00:46.399642 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-2d5f8a28-482b-4fea-94a8-c83d9c68c467 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8604f942d44fec96828cc0b1ae5960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b729993a1944061bb0a708877c95a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:46.408683 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-2d5f8a28-482b-4fea-94a8-c83d9c68c467 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] 10.222.0.81 "GET /compute/v2.1/servers/990431e1-82cb-42b0-a288-949d79e21762" status: 200 len: 1304 microversion: 2.1 time: 0.155985 May 26 15:00:46.409265 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 301/577] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:00:46 2021] GET /compute/v2.1/servers/990431e1-82cb-42b0-a288-949d79e21762 => generated 1304 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:00:46.578752 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-98832112-2061-4d6e-a025-f067dd45cac8 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:46.591384 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-98832112-2061-4d6e-a025-f067dd45cac8 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] [instance: aa145a33-41b1-4e39-9642-132aca11fcfe] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:46.591384 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-98832112-2061-4d6e-a025-f067dd45cac8 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:46.591384 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-98832112-2061-4d6e-a025-f067dd45cac8 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:46.591384 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-98832112-2061-4d6e-a025-f067dd45cac8 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:46.591887 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-98832112-2061-4d6e-a025-f067dd45cac8 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:46.823126 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-98832112-2061-4d6e-a025-f067dd45cac8 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b167942c895345b186a3eda5c82175b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad2ab2705ca479ab4aaafe7c80de162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:46.833278 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-98832112-2061-4d6e-a025-f067dd45cac8 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /compute/v2.1/servers/aa145a33-41b1-4e39-9642-132aca11fcfe" status: 200 len: 1555 microversion: 2.1 time: 0.259470 May 26 15:00:46.834129 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 277/578] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:00:46 2021] GET /compute/v2.1/servers/aa145a33-41b1-4e39-9642-132aca11fcfe => generated 1555 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:00:46.919208 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-3cb32335-a65b-401f-bdda-16752eeb38f9 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:46.920507 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-3cb32335-a65b-401f-bdda-16752eeb38f9 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 598b0e3f-8cf1-451a-80a8-ed7e5dd36984] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:46.930499 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-3cb32335-a65b-401f-bdda-16752eeb38f9 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:46.930954 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-3cb32335-a65b-401f-bdda-16752eeb38f9 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:46.931969 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-3cb32335-a65b-401f-bdda-16752eeb38f9 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:46.932414 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-3cb32335-a65b-401f-bdda-16752eeb38f9 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:47.144489 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-3cb32335-a65b-401f-bdda-16752eeb38f9 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:47.154693 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-3cb32335-a65b-401f-bdda-16752eeb38f9 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:47.156827 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-3cb32335-a65b-401f-bdda-16752eeb38f9 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:47.158008 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-3cb32335-a65b-401f-bdda-16752eeb38f9 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984" status: 200 len: 1807 microversion: 2.20 time: 0.242990 May 26 15:00:47.162296 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 302/579] 10.222.0.81 () {60 vars in 1277 bytes} [Wed May 26 15:00:46 2021] GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984 => generated 1807 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:00:47.266763 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-f583898c-6ad9-4f6d-8861-13dd5e70b628 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:47.267379 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-f583898c-6ad9-4f6d-8861-13dd5e70b628 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] [instance: 4266a63b-9328-4c00-81d2-3583ceb5d080] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:47.274835 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-f583898c-6ad9-4f6d-8861-13dd5e70b628 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:47.275329 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-f583898c-6ad9-4f6d-8861-13dd5e70b628 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:47.276372 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-f583898c-6ad9-4f6d-8861-13dd5e70b628 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:47.276813 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-f583898c-6ad9-4f6d-8861-13dd5e70b628 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:47.395602 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-95804d78-25be-46ca-b226-57cadc7dea3c tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:47.396223 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-95804d78-25be-46ca-b226-57cadc7dea3c tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] [instance: 8e4e2075-5a0f-4e15-892d-e4b5eb5b8807] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:47.404961 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-95804d78-25be-46ca-b226-57cadc7dea3c tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:47.404961 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-95804d78-25be-46ca-b226-57cadc7dea3c tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:47.405806 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-95804d78-25be-46ca-b226-57cadc7dea3c tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:47.407137 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-95804d78-25be-46ca-b226-57cadc7dea3c tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:47.512786 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-f583898c-6ad9-4f6d-8861-13dd5e70b628 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be4bd5c0f2a400da491bae101b48832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515325707f64d58a28f26451b2c74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:47.524003 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-f583898c-6ad9-4f6d-8861-13dd5e70b628 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /compute/v2.1/servers/4266a63b-9328-4c00-81d2-3583ceb5d080" status: 200 len: 1317 microversion: 2.1 time: 0.260960 May 26 15:00:47.525017 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 278/580] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:00:47 2021] GET /compute/v2.1/servers/4266a63b-9328-4c00-81d2-3583ceb5d080 => generated 1317 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:00:47.529737 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-6eb02a60-af93-4192-b9e7-0190bc092a73 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:47.530419 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-6eb02a60-af93-4192-b9e7-0190bc092a73 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] [instance: 990431e1-82cb-42b0-a288-949d79e21762] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:47.541051 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-6eb02a60-af93-4192-b9e7-0190bc092a73 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:47.541513 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-6eb02a60-af93-4192-b9e7-0190bc092a73 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:47.542343 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-6eb02a60-af93-4192-b9e7-0190bc092a73 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:47.542786 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-6eb02a60-af93-4192-b9e7-0190bc092a73 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:47.639755 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-95804d78-25be-46ca-b226-57cadc7dea3c tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96610ea2bcf84875be6d08859dd0c7b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dffd269c3a344d36b77ebb04d0c412e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:47.649463 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-95804d78-25be-46ca-b226-57cadc7dea3c tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] 10.222.0.81 "GET /compute/v2.1/servers/8e4e2075-5a0f-4e15-892d-e4b5eb5b8807" status: 200 len: 1314 microversion: 2.1 time: 0.259366 May 26 15:00:47.650204 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 303/581] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:00:47 2021] GET /compute/v2.1/servers/8e4e2075-5a0f-4e15-892d-e4b5eb5b8807 => generated 1314 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:00:47.667019 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-6eb02a60-af93-4192-b9e7-0190bc092a73 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8604f942d44fec96828cc0b1ae5960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b729993a1944061bb0a708877c95a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:47.675824 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-6eb02a60-af93-4192-b9e7-0190bc092a73 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] 10.222.0.81 "GET /compute/v2.1/servers/990431e1-82cb-42b0-a288-949d79e21762" status: 200 len: 1304 microversion: 2.1 time: 0.149969 May 26 15:00:47.676394 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 279/582] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:00:47 2021] GET /compute/v2.1/servers/990431e1-82cb-42b0-a288-949d79e21762 => generated 1304 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:00:47.850801 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-ddd3da4f-a3bf-4e60-a322-058e10afe552 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:47.851443 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-ddd3da4f-a3bf-4e60-a322-058e10afe552 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] [instance: aa145a33-41b1-4e39-9642-132aca11fcfe] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:47.859022 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-ddd3da4f-a3bf-4e60-a322-058e10afe552 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:47.860782 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-ddd3da4f-a3bf-4e60-a322-058e10afe552 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:47.861616 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-ddd3da4f-a3bf-4e60-a322-058e10afe552 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:47.862132 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-ddd3da4f-a3bf-4e60-a322-058e10afe552 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:47.963649 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-0deb24f6-2b74-402c-a7f4-1592f834f5fd tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1402235789", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1867552409", "security_groups": [{"name": "tempest-secgroup-smoke-1398860261"}], "networks": [{"uuid": "e30d7c90-8779-49cd-96d8-5c4ae28c55f9"}], "block_device_mapping_v2": [{"uuid": "28aed550-4fbc-45b2-882e-eed1644721ad", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:00:48.073688 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-ddd3da4f-a3bf-4e60-a322-058e10afe552 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b167942c895345b186a3eda5c82175b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad2ab2705ca479ab4aaafe7c80de162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:48.085831 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-ddd3da4f-a3bf-4e60-a322-058e10afe552 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /compute/v2.1/servers/aa145a33-41b1-4e39-9642-132aca11fcfe" status: 200 len: 1555 microversion: 2.1 time: 0.238561 May 26 15:00:48.096254 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 304/583] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:00:47 2021] GET /compute/v2.1/servers/aa145a33-41b1-4e39-9642-132aca11fcfe => generated 1555 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:00:48.176564 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-67ac37fb-350d-471a-ad2c-b4ce47253a17 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:48.178294 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-67ac37fb-350d-471a-ad2c-b4ce47253a17 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 598b0e3f-8cf1-451a-80a8-ed7e5dd36984] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:48.185700 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-67ac37fb-350d-471a-ad2c-b4ce47253a17 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:48.186208 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-67ac37fb-350d-471a-ad2c-b4ce47253a17 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:48.186990 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-67ac37fb-350d-471a-ad2c-b4ce47253a17 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:48.188094 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-67ac37fb-350d-471a-ad2c-b4ce47253a17 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:48.255781 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.network.neutron [None req-0deb24f6-2b74-402c-a7f4-1592f834f5fd tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] validate_networks() for [('e30d7c90-8779-49cd-96d8-5c4ae28c55f9', None, None, None)] {{(pid=118514) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} May 26 15:00:48.402716 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-67ac37fb-350d-471a-ad2c-b4ce47253a17 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:48.412196 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-67ac37fb-350d-471a-ad2c-b4ce47253a17 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:48.413730 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-67ac37fb-350d-471a-ad2c-b4ce47253a17 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:48.415141 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-67ac37fb-350d-471a-ad2c-b4ce47253a17 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984" status: 200 len: 1807 microversion: 2.20 time: 0.243166 May 26 15:00:48.415719 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 305/584] 10.222.0.81 () {60 vars in 1277 bytes} [Wed May 26 15:00:48 2021] GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984 => generated 1807 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 15:00:48.549864 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-50a073fe-7026-4656-9952-ac2c3988dc9c tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:48.551004 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-50a073fe-7026-4656-9952-ac2c3988dc9c tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] [instance: 4266a63b-9328-4c00-81d2-3583ceb5d080] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:48.565052 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-50a073fe-7026-4656-9952-ac2c3988dc9c tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:48.566158 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-50a073fe-7026-4656-9952-ac2c3988dc9c tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:48.567902 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-50a073fe-7026-4656-9952-ac2c3988dc9c tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:48.569444 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-50a073fe-7026-4656-9952-ac2c3988dc9c tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:48.830519 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-50a073fe-7026-4656-9952-ac2c3988dc9c tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be4bd5c0f2a400da491bae101b48832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515325707f64d58a28f26451b2c74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:48.839779 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-50a073fe-7026-4656-9952-ac2c3988dc9c tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /compute/v2.1/servers/4266a63b-9328-4c00-81d2-3583ceb5d080" status: 200 len: 1317 microversion: 2.1 time: 0.297229 May 26 15:00:48.840971 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 306/585] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:00:48 2021] GET /compute/v2.1/servers/4266a63b-9328-4c00-81d2-3583ceb5d080 => generated 1317 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:00:48.849902 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-11ca62c8-f78b-4de8-b286-7422af037c9f tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:48.850683 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-11ca62c8-f78b-4de8-b286-7422af037c9f tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] [instance: 8e4e2075-5a0f-4e15-892d-e4b5eb5b8807] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:48.865166 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-11ca62c8-f78b-4de8-b286-7422af037c9f tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:48.866175 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-11ca62c8-f78b-4de8-b286-7422af037c9f tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:48.867176 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-11ca62c8-f78b-4de8-b286-7422af037c9f tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:48.867696 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-11ca62c8-f78b-4de8-b286-7422af037c9f tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:48.868640 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.virt.hardware [None req-0deb24f6-2b74-402c-a7f4-1592f834f5fd tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Flavor limits 0:0:0 {{(pid=118514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} May 26 15:00:48.869114 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.virt.hardware [None req-0deb24f6-2b74-402c-a7f4-1592f834f5fd tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Image limits 0:0:0 {{(pid=118514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} May 26 15:00:48.869576 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.virt.hardware [None req-0deb24f6-2b74-402c-a7f4-1592f834f5fd tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Flavor pref 0:0:0 {{(pid=118514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} May 26 15:00:48.869995 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.virt.hardware [None req-0deb24f6-2b74-402c-a7f4-1592f834f5fd tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Image pref 0:0:0 {{(pid=118514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} May 26 15:00:48.870421 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.virt.hardware [None req-0deb24f6-2b74-402c-a7f4-1592f834f5fd tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} May 26 15:00:48.881640 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-0deb24f6-2b74-402c-a7f4-1592f834f5fd tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:48.882198 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-0deb24f6-2b74-402c-a7f4-1592f834f5fd tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:48.883182 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-0deb24f6-2b74-402c-a7f4-1592f834f5fd tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:48.883843 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-0deb24f6-2b74-402c-a7f4-1592f834f5fd tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:48.907116 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.quota [None req-0deb24f6-2b74-402c-a7f4-1592f834f5fd tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Getting quotas for project 07c65d1e254f424ebfea8360aa697c34. Resources: {'instances', 'ram', 'cores'} {{(pid=118514) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 26 15:00:48.912210 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.quota [None req-0deb24f6-2b74-402c-a7f4-1592f834f5fd tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Getting quotas for user 565618950dd54005a4a040f4dd0cbb33 and project 07c65d1e254f424ebfea8360aa697c34. Resources: {'instances', 'ram', 'cores'} {{(pid=118514) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 26 15:00:49.022103 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-0deb24f6-2b74-402c-a7f4-1592f834f5fd tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Going to run 1 instances... {{(pid=118514) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 26 15:00:49.024541 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-0deb24f6-2b74-402c-a7f4-1592f834f5fd tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] [instance: 29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='28aed550-4fbc-45b2-882e-eed1644721ad',volume_size=None,volume_type=None)] {{(pid=118514) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} May 26 15:00:49.087938 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-11ca62c8-f78b-4de8-b286-7422af037c9f tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96610ea2bcf84875be6d08859dd0c7b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dffd269c3a344d36b77ebb04d0c412e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:49.106758 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-11ca62c8-f78b-4de8-b286-7422af037c9f tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] 10.222.0.81 "GET /compute/v2.1/servers/8e4e2075-5a0f-4e15-892d-e4b5eb5b8807" status: 200 len: 1314 microversion: 2.1 time: 0.264076 May 26 15:00:49.114753 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 307/586] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:00:48 2021] GET /compute/v2.1/servers/8e4e2075-5a0f-4e15-892d-e4b5eb5b8807 => generated 1314 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:00:49.119499 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-2a726887-6fb2-4273-a5a5-29230a904a7f tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:49.120118 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-2a726887-6fb2-4273-a5a5-29230a904a7f tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] [instance: 990431e1-82cb-42b0-a288-949d79e21762] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:49.127908 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-2a726887-6fb2-4273-a5a5-29230a904a7f tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:49.128502 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-2a726887-6fb2-4273-a5a5-29230a904a7f tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:49.129403 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-2a726887-6fb2-4273-a5a5-29230a904a7f tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:49.129912 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-2a726887-6fb2-4273-a5a5-29230a904a7f tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:49.326518 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-2a726887-6fb2-4273-a5a5-29230a904a7f tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8604f942d44fec96828cc0b1ae5960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b729993a1944061bb0a708877c95a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:49.335677 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-2a726887-6fb2-4273-a5a5-29230a904a7f tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] 10.222.0.81 "GET /compute/v2.1/servers/990431e1-82cb-42b0-a288-949d79e21762" status: 200 len: 1304 microversion: 2.1 time: 0.219760 May 26 15:00:49.336390 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 308/587] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:00:49 2021] GET /compute/v2.1/servers/990431e1-82cb-42b0-a288-949d79e21762 => generated 1304 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:00:49.341530 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-f772473d-4122-40e9-86ea-487182a784be tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:49.342136 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-f772473d-4122-40e9-86ea-487182a784be tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] [instance: aa145a33-41b1-4e39-9642-132aca11fcfe] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:49.354196 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-f772473d-4122-40e9-86ea-487182a784be tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:49.354932 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-f772473d-4122-40e9-86ea-487182a784be tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:49.355927 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-f772473d-4122-40e9-86ea-487182a784be tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:49.356579 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-f772473d-4122-40e9-86ea-487182a784be tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:49.572747 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-f772473d-4122-40e9-86ea-487182a784be tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b167942c895345b186a3eda5c82175b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad2ab2705ca479ab4aaafe7c80de162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:49.582373 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-f772473d-4122-40e9-86ea-487182a784be tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /compute/v2.1/servers/aa145a33-41b1-4e39-9642-132aca11fcfe" status: 200 len: 1555 microversion: 2.1 time: 0.244919 May 26 15:00:49.582888 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 309/588] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:00:49 2021] GET /compute/v2.1/servers/aa145a33-41b1-4e39-9642-132aca11fcfe => generated 1555 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:00:49.587166 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-1a65986d-cc04-48c3-a4f6-70fabd863ac7 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:49.587776 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-1a65986d-cc04-48c3-a4f6-70fabd863ac7 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 598b0e3f-8cf1-451a-80a8-ed7e5dd36984] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:49.595809 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-1a65986d-cc04-48c3-a4f6-70fabd863ac7 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:49.596272 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-1a65986d-cc04-48c3-a4f6-70fabd863ac7 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:49.597060 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-1a65986d-cc04-48c3-a4f6-70fabd863ac7 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:49.597557 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-1a65986d-cc04-48c3-a4f6-70fabd863ac7 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:49.807294 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-1a65986d-cc04-48c3-a4f6-70fabd863ac7 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:49.818989 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-1a65986d-cc04-48c3-a4f6-70fabd863ac7 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:49.820642 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-1a65986d-cc04-48c3-a4f6-70fabd863ac7 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:49.821837 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-1a65986d-cc04-48c3-a4f6-70fabd863ac7 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984" status: 200 len: 1807 microversion: 2.20 time: 0.237977 May 26 15:00:49.822395 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 310/589] 10.222.0.81 () {60 vars in 1277 bytes} [Wed May 26 15:00:49 2021] GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984 => generated 1807 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:00:49.857456 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-73972d95-fe63-4e6b-87d5-fe4b49a4bdd6 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:49.858024 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-73972d95-fe63-4e6b-87d5-fe4b49a4bdd6 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] [instance: 4266a63b-9328-4c00-81d2-3583ceb5d080] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:49.866188 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-73972d95-fe63-4e6b-87d5-fe4b49a4bdd6 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:49.866685 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-73972d95-fe63-4e6b-87d5-fe4b49a4bdd6 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:49.867513 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-73972d95-fe63-4e6b-87d5-fe4b49a4bdd6 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:49.867985 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-73972d95-fe63-4e6b-87d5-fe4b49a4bdd6 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:49.915187 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-0deb24f6-2b74-402c-a7f4-1592f834f5fd tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.955167 May 26 15:00:49.916868 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 280/590] 10.222.0.81 () {60 vars in 1147 bytes} [Wed May 26 15:00:47 2021] POST /compute/v2.1/servers => generated 406 bytes in 1957 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 26 15:00:49.928520 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-38be1b39-3b2e-4e4c-966c-2202dd82a160 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:49.929534 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-38be1b39-3b2e-4e4c-966c-2202dd82a160 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] [instance: 29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:50.048393 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-38be1b39-3b2e-4e4c-966c-2202dd82a160 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565618950dd54005a4a040f4dd0cbb33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c65d1e254f424ebfea8360aa697c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:50.057810 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-38be1b39-3b2e-4e4c-966c-2202dd82a160 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /compute/v2.1/servers/29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de" status: 200 len: 1089 microversion: 2.1 time: 0.133348 May 26 15:00:50.069807 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 281/591] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:00:49 2021] GET /compute/v2.1/servers/29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de => generated 1089 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:00:50.122452 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-6326e01b-45f6-40d5-8ce8-aa554e46a95f tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:50.123108 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-6326e01b-45f6-40d5-8ce8-aa554e46a95f tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] [instance: 8e4e2075-5a0f-4e15-892d-e4b5eb5b8807] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:50.127954 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-73972d95-fe63-4e6b-87d5-fe4b49a4bdd6 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be4bd5c0f2a400da491bae101b48832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515325707f64d58a28f26451b2c74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:50.130808 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-6326e01b-45f6-40d5-8ce8-aa554e46a95f tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:50.131337 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-6326e01b-45f6-40d5-8ce8-aa554e46a95f tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:50.132396 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-6326e01b-45f6-40d5-8ce8-aa554e46a95f tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:50.132915 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-6326e01b-45f6-40d5-8ce8-aa554e46a95f tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:50.136343 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-73972d95-fe63-4e6b-87d5-fe4b49a4bdd6 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /compute/v2.1/servers/4266a63b-9328-4c00-81d2-3583ceb5d080" status: 200 len: 1317 microversion: 2.1 time: 0.282637 May 26 15:00:50.137110 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 311/592] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:00:49 2021] GET /compute/v2.1/servers/4266a63b-9328-4c00-81d2-3583ceb5d080 => generated 1317 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:00:50.401202 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-6326e01b-45f6-40d5-8ce8-aa554e46a95f tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96610ea2bcf84875be6d08859dd0c7b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dffd269c3a344d36b77ebb04d0c412e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:50.401470 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-70a8cfed-fbc7-4fbd-832e-3e4fec6a1591 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:50.401470 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-70a8cfed-fbc7-4fbd-832e-3e4fec6a1591 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] [instance: 990431e1-82cb-42b0-a288-949d79e21762] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:50.401708 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-6326e01b-45f6-40d5-8ce8-aa554e46a95f tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] 10.222.0.81 "GET /compute/v2.1/servers/8e4e2075-5a0f-4e15-892d-e4b5eb5b8807" status: 200 len: 1314 microversion: 2.1 time: 0.240195 May 26 15:00:50.401708 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 282/593] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:00:50 2021] GET /compute/v2.1/servers/8e4e2075-5a0f-4e15-892d-e4b5eb5b8807 => generated 1314 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:00:50.401893 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-70a8cfed-fbc7-4fbd-832e-3e4fec6a1591 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:50.401893 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-70a8cfed-fbc7-4fbd-832e-3e4fec6a1591 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:50.401893 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-70a8cfed-fbc7-4fbd-832e-3e4fec6a1591 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:50.401893 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-70a8cfed-fbc7-4fbd-832e-3e4fec6a1591 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:50.494607 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-70a8cfed-fbc7-4fbd-832e-3e4fec6a1591 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8604f942d44fec96828cc0b1ae5960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b729993a1944061bb0a708877c95a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:50.503694 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-70a8cfed-fbc7-4fbd-832e-3e4fec6a1591 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] 10.222.0.81 "GET /compute/v2.1/servers/990431e1-82cb-42b0-a288-949d79e21762" status: 200 len: 1304 microversion: 2.1 time: 0.153822 May 26 15:00:50.504309 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 312/594] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:00:50 2021] GET /compute/v2.1/servers/990431e1-82cb-42b0-a288-949d79e21762 => generated 1304 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:00:50.602107 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-7e923653-ab4f-46cb-8301-90397da00df0 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:50.603215 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-7e923653-ab4f-46cb-8301-90397da00df0 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] [instance: aa145a33-41b1-4e39-9642-132aca11fcfe] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:50.611323 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-7e923653-ab4f-46cb-8301-90397da00df0 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:50.612059 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-7e923653-ab4f-46cb-8301-90397da00df0 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:50.612981 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-7e923653-ab4f-46cb-8301-90397da00df0 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:50.613417 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-7e923653-ab4f-46cb-8301-90397da00df0 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:50.826070 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-7e923653-ab4f-46cb-8301-90397da00df0 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b167942c895345b186a3eda5c82175b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad2ab2705ca479ab4aaafe7c80de162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:50.836314 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-7e923653-ab4f-46cb-8301-90397da00df0 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /compute/v2.1/servers/aa145a33-41b1-4e39-9642-132aca11fcfe" status: 200 len: 1555 microversion: 2.1 time: 0.239169 May 26 15:00:50.837040 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 283/595] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:00:50 2021] GET /compute/v2.1/servers/aa145a33-41b1-4e39-9642-132aca11fcfe => generated 1555 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:00:50.843774 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-eb807dd2-bff8-4b37-92d7-8bb529e5e49e tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:50.844397 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-eb807dd2-bff8-4b37-92d7-8bb529e5e49e tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 598b0e3f-8cf1-451a-80a8-ed7e5dd36984] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:50.851746 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-eb807dd2-bff8-4b37-92d7-8bb529e5e49e tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:50.852210 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-eb807dd2-bff8-4b37-92d7-8bb529e5e49e tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:50.853006 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-eb807dd2-bff8-4b37-92d7-8bb529e5e49e tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:50.853449 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-eb807dd2-bff8-4b37-92d7-8bb529e5e49e tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:51.076516 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-98a6849c-c950-43d1-a5e1-47d3e1064d68 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:51.077149 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-98a6849c-c950-43d1-a5e1-47d3e1064d68 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] [instance: 29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:51.081486 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-eb807dd2-bff8-4b37-92d7-8bb529e5e49e tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:51.091092 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-eb807dd2-bff8-4b37-92d7-8bb529e5e49e tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:51.092717 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-eb807dd2-bff8-4b37-92d7-8bb529e5e49e tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:51.094179 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-eb807dd2-bff8-4b37-92d7-8bb529e5e49e tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984" status: 200 len: 1807 microversion: 2.20 time: 0.253940 May 26 15:00:51.104950 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 313/596] 10.222.0.81 () {60 vars in 1277 bytes} [Wed May 26 15:00:50 2021] GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984 => generated 1807 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 15:00:51.153673 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-98a6849c-c950-43d1-a5e1-47d3e1064d68 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565618950dd54005a4a040f4dd0cbb33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c65d1e254f424ebfea8360aa697c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:51.153958 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-0ef1ac52-fb85-4b32-a1bf-e2bcd80f84fc tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:51.154592 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-0ef1ac52-fb85-4b32-a1bf-e2bcd80f84fc tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] [instance: 4266a63b-9328-4c00-81d2-3583ceb5d080] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:51.162360 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-0ef1ac52-fb85-4b32-a1bf-e2bcd80f84fc tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:51.162854 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-98a6849c-c950-43d1-a5e1-47d3e1064d68 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /compute/v2.1/servers/29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de" status: 200 len: 1089 microversion: 2.1 time: 0.089930 May 26 15:00:51.163276 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-0ef1ac52-fb85-4b32-a1bf-e2bcd80f84fc tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:51.163956 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 284/597] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:00:51 2021] GET /compute/v2.1/servers/29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de => generated 1089 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:00:51.164712 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-0ef1ac52-fb85-4b32-a1bf-e2bcd80f84fc tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:51.165195 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-0ef1ac52-fb85-4b32-a1bf-e2bcd80f84fc tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:51.378123 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-0ef1ac52-fb85-4b32-a1bf-e2bcd80f84fc tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be4bd5c0f2a400da491bae101b48832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515325707f64d58a28f26451b2c74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:51.386607 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-0ef1ac52-fb85-4b32-a1bf-e2bcd80f84fc tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /compute/v2.1/servers/4266a63b-9328-4c00-81d2-3583ceb5d080" status: 200 len: 1317 microversion: 2.1 time: 0.237534 May 26 15:00:51.387287 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 314/598] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:00:51 2021] GET /compute/v2.1/servers/4266a63b-9328-4c00-81d2-3583ceb5d080 => generated 1317 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:00:51.438338 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-2514a472-46ca-4d6e-947b-41a8ea526b78 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:51.438962 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-2514a472-46ca-4d6e-947b-41a8ea526b78 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] [instance: 8e4e2075-5a0f-4e15-892d-e4b5eb5b8807] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:51.448198 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-2514a472-46ca-4d6e-947b-41a8ea526b78 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:51.448660 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-2514a472-46ca-4d6e-947b-41a8ea526b78 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:51.449460 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-2514a472-46ca-4d6e-947b-41a8ea526b78 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:51.449979 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-2514a472-46ca-4d6e-947b-41a8ea526b78 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:51.527219 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-d307d6fb-18b2-4209-a155-13b48a780e7f tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:51.528309 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-d307d6fb-18b2-4209-a155-13b48a780e7f tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] [instance: 990431e1-82cb-42b0-a288-949d79e21762] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:51.543471 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-d307d6fb-18b2-4209-a155-13b48a780e7f tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:51.543998 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-d307d6fb-18b2-4209-a155-13b48a780e7f tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:51.544865 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-d307d6fb-18b2-4209-a155-13b48a780e7f tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:51.545369 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-d307d6fb-18b2-4209-a155-13b48a780e7f tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:51.669459 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-d307d6fb-18b2-4209-a155-13b48a780e7f tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8604f942d44fec96828cc0b1ae5960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b729993a1944061bb0a708877c95a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:51.676683 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-2514a472-46ca-4d6e-947b-41a8ea526b78 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96610ea2bcf84875be6d08859dd0c7b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dffd269c3a344d36b77ebb04d0c412e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:51.680852 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-d307d6fb-18b2-4209-a155-13b48a780e7f tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] 10.222.0.81 "GET /compute/v2.1/servers/990431e1-82cb-42b0-a288-949d79e21762" status: 200 len: 1304 microversion: 2.1 time: 0.164437 May 26 15:00:51.681918 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 315/599] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:00:51 2021] GET /compute/v2.1/servers/990431e1-82cb-42b0-a288-949d79e21762 => generated 1304 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:00:51.687240 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-2514a472-46ca-4d6e-947b-41a8ea526b78 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] 10.222.0.81 "GET /compute/v2.1/servers/8e4e2075-5a0f-4e15-892d-e4b5eb5b8807" status: 200 len: 1314 microversion: 2.1 time: 0.253144 May 26 15:00:51.690927 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 285/600] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:00:51 2021] GET /compute/v2.1/servers/8e4e2075-5a0f-4e15-892d-e4b5eb5b8807 => generated 1314 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:00:51.853496 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-c36ede29-6210-43b4-9eb9-2c606ebbc74f tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:51.854128 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-c36ede29-6210-43b4-9eb9-2c606ebbc74f tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] [instance: aa145a33-41b1-4e39-9642-132aca11fcfe] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:51.862118 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-c36ede29-6210-43b4-9eb9-2c606ebbc74f tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:51.862565 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-c36ede29-6210-43b4-9eb9-2c606ebbc74f tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:51.863337 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-c36ede29-6210-43b4-9eb9-2c606ebbc74f tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:51.863779 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-c36ede29-6210-43b4-9eb9-2c606ebbc74f tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:52.072334 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-c36ede29-6210-43b4-9eb9-2c606ebbc74f tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b167942c895345b186a3eda5c82175b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad2ab2705ca479ab4aaafe7c80de162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:52.082117 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-c36ede29-6210-43b4-9eb9-2c606ebbc74f tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /compute/v2.1/servers/aa145a33-41b1-4e39-9642-132aca11fcfe" status: 200 len: 1555 microversion: 2.1 time: 0.232285 May 26 15:00:52.082931 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 316/601] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:00:51 2021] GET /compute/v2.1/servers/aa145a33-41b1-4e39-9642-132aca11fcfe => generated 1555 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:00:52.112276 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-b0260ca2-35db-467c-88ec-2158dd5330b4 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:52.113581 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-b0260ca2-35db-467c-88ec-2158dd5330b4 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 598b0e3f-8cf1-451a-80a8-ed7e5dd36984] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:52.121936 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-b0260ca2-35db-467c-88ec-2158dd5330b4 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:52.122666 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-b0260ca2-35db-467c-88ec-2158dd5330b4 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:52.123594 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-b0260ca2-35db-467c-88ec-2158dd5330b4 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:52.124039 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-b0260ca2-35db-467c-88ec-2158dd5330b4 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:52.180317 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-8b699559-b7b9-48da-9273-fcb6c2a687bd tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:52.181803 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-8b699559-b7b9-48da-9273-fcb6c2a687bd tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] [instance: 29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:52.192155 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-8b699559-b7b9-48da-9273-fcb6c2a687bd tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:52.196561 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-8b699559-b7b9-48da-9273-fcb6c2a687bd tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:52.196561 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-8b699559-b7b9-48da-9273-fcb6c2a687bd tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:52.196561 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-8b699559-b7b9-48da-9273-fcb6c2a687bd tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:52.338509 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-b0260ca2-35db-467c-88ec-2158dd5330b4 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:52.348773 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-b0260ca2-35db-467c-88ec-2158dd5330b4 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:52.350414 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-b0260ca2-35db-467c-88ec-2158dd5330b4 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:52.351512 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-b0260ca2-35db-467c-88ec-2158dd5330b4 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984" status: 200 len: 1807 microversion: 2.20 time: 0.243064 May 26 15:00:52.352060 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 286/602] 10.222.0.81 () {60 vars in 1277 bytes} [Wed May 26 15:00:52 2021] GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984 => generated 1807 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:00:52.399633 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-8b699559-b7b9-48da-9273-fcb6c2a687bd tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565618950dd54005a4a040f4dd0cbb33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c65d1e254f424ebfea8360aa697c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:52.404375 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-85144b49-caf3-477d-bda2-d108e01e9b9a tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:52.405303 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-85144b49-caf3-477d-bda2-d108e01e9b9a tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] [instance: 4266a63b-9328-4c00-81d2-3583ceb5d080] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:52.411303 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-8b699559-b7b9-48da-9273-fcb6c2a687bd tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /compute/v2.1/servers/29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de" status: 200 len: 1139 microversion: 2.1 time: 0.234768 May 26 15:00:52.411993 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 317/603] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:00:52 2021] GET /compute/v2.1/servers/29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de => generated 1139 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:00:52.415117 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-85144b49-caf3-477d-bda2-d108e01e9b9a tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:52.415772 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-85144b49-caf3-477d-bda2-d108e01e9b9a tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:52.416574 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-85144b49-caf3-477d-bda2-d108e01e9b9a tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:52.417140 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-85144b49-caf3-477d-bda2-d108e01e9b9a tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:52.644547 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-85144b49-caf3-477d-bda2-d108e01e9b9a tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be4bd5c0f2a400da491bae101b48832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515325707f64d58a28f26451b2c74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:52.653715 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-85144b49-caf3-477d-bda2-d108e01e9b9a tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /compute/v2.1/servers/4266a63b-9328-4c00-81d2-3583ceb5d080" status: 200 len: 1317 microversion: 2.1 time: 0.253774 May 26 15:00:52.654296 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 287/604] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:00:52 2021] GET /compute/v2.1/servers/4266a63b-9328-4c00-81d2-3583ceb5d080 => generated 1317 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:00:52.698028 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-be959f16-9344-4abf-a811-452a39fe36b1 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:52.698710 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-be959f16-9344-4abf-a811-452a39fe36b1 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] [instance: 990431e1-82cb-42b0-a288-949d79e21762] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:52.707113 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-84a73efa-9933-4f29-9b21-da05c6c33c69 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:52.707725 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-84a73efa-9933-4f29-9b21-da05c6c33c69 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] [instance: 8e4e2075-5a0f-4e15-892d-e4b5eb5b8807] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:52.712993 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-be959f16-9344-4abf-a811-452a39fe36b1 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:52.713471 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-be959f16-9344-4abf-a811-452a39fe36b1 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:52.714312 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-be959f16-9344-4abf-a811-452a39fe36b1 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:52.714769 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-be959f16-9344-4abf-a811-452a39fe36b1 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:52.715607 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-84a73efa-9933-4f29-9b21-da05c6c33c69 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:52.716062 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-84a73efa-9933-4f29-9b21-da05c6c33c69 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:52.716841 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-84a73efa-9933-4f29-9b21-da05c6c33c69 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:52.717275 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-84a73efa-9933-4f29-9b21-da05c6c33c69 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:52.837359 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-be959f16-9344-4abf-a811-452a39fe36b1 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8604f942d44fec96828cc0b1ae5960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b729993a1944061bb0a708877c95a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:52.846176 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-be959f16-9344-4abf-a811-452a39fe36b1 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] 10.222.0.81 "GET /compute/v2.1/servers/990431e1-82cb-42b0-a288-949d79e21762" status: 200 len: 1304 microversion: 2.1 time: 0.151786 May 26 15:00:52.846983 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 318/605] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:00:52 2021] GET /compute/v2.1/servers/990431e1-82cb-42b0-a288-949d79e21762 => generated 1304 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:00:52.929892 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-84a73efa-9933-4f29-9b21-da05c6c33c69 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96610ea2bcf84875be6d08859dd0c7b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dffd269c3a344d36b77ebb04d0c412e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:52.939792 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-84a73efa-9933-4f29-9b21-da05c6c33c69 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] 10.222.0.81 "GET /compute/v2.1/servers/8e4e2075-5a0f-4e15-892d-e4b5eb5b8807" status: 200 len: 1314 microversion: 2.1 time: 0.236892 May 26 15:00:52.940367 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 288/606] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:00:52 2021] GET /compute/v2.1/servers/8e4e2075-5a0f-4e15-892d-e4b5eb5b8807 => generated 1314 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:00:53.099031 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-7ea820aa-41dd-407e-9606-b5f78d9699a6 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:53.099569 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-7ea820aa-41dd-407e-9606-b5f78d9699a6 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] [instance: aa145a33-41b1-4e39-9642-132aca11fcfe] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:53.107013 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-7ea820aa-41dd-407e-9606-b5f78d9699a6 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:53.107474 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-7ea820aa-41dd-407e-9606-b5f78d9699a6 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:53.108269 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-7ea820aa-41dd-407e-9606-b5f78d9699a6 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:53.108688 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-7ea820aa-41dd-407e-9606-b5f78d9699a6 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:53.307348 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-7ea820aa-41dd-407e-9606-b5f78d9699a6 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b167942c895345b186a3eda5c82175b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad2ab2705ca479ab4aaafe7c80de162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:53.316115 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-7ea820aa-41dd-407e-9606-b5f78d9699a6 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /compute/v2.1/servers/aa145a33-41b1-4e39-9642-132aca11fcfe" status: 200 len: 1555 microversion: 2.1 time: 0.220860 May 26 15:00:53.316710 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 319/607] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:00:53 2021] GET /compute/v2.1/servers/aa145a33-41b1-4e39-9642-132aca11fcfe => generated 1555 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:00:53.369390 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-2a195c72-ed5a-44f7-89a0-ee346d30a20f tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:53.369962 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-2a195c72-ed5a-44f7-89a0-ee346d30a20f tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 598b0e3f-8cf1-451a-80a8-ed7e5dd36984] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:53.377345 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-2a195c72-ed5a-44f7-89a0-ee346d30a20f tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:53.377822 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-2a195c72-ed5a-44f7-89a0-ee346d30a20f tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:53.378592 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-2a195c72-ed5a-44f7-89a0-ee346d30a20f tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:53.379033 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-2a195c72-ed5a-44f7-89a0-ee346d30a20f tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:53.427138 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-f3c3f013-3b37-4948-8ffc-92d800d23c8e tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:53.427852 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-f3c3f013-3b37-4948-8ffc-92d800d23c8e tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] [instance: 29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:53.435477 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-f3c3f013-3b37-4948-8ffc-92d800d23c8e tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:53.444241 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-f3c3f013-3b37-4948-8ffc-92d800d23c8e tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:53.444241 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-f3c3f013-3b37-4948-8ffc-92d800d23c8e tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:53.444241 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-f3c3f013-3b37-4948-8ffc-92d800d23c8e tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:53.602461 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-f3c3f013-3b37-4948-8ffc-92d800d23c8e tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565618950dd54005a4a040f4dd0cbb33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c65d1e254f424ebfea8360aa697c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:53.613236 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-f3c3f013-3b37-4948-8ffc-92d800d23c8e tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /compute/v2.1/servers/29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de" status: 200 len: 1139 microversion: 2.1 time: 0.189702 May 26 15:00:53.614140 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 320/608] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:00:53 2021] GET /compute/v2.1/servers/29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de => generated 1139 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:00:53.629093 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-2a195c72-ed5a-44f7-89a0-ee346d30a20f tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:53.638337 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-2a195c72-ed5a-44f7-89a0-ee346d30a20f tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:53.639869 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-2a195c72-ed5a-44f7-89a0-ee346d30a20f tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:53.641579 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-2a195c72-ed5a-44f7-89a0-ee346d30a20f tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984" status: 200 len: 1807 microversion: 2.20 time: 0.275908 May 26 15:00:53.642383 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 289/609] 10.222.0.81 () {60 vars in 1277 bytes} [Wed May 26 15:00:53 2021] GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984 => generated 1807 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:00:53.670610 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-232a752e-acd5-462b-862f-ad140b0ab5d3 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:53.671239 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-232a752e-acd5-462b-862f-ad140b0ab5d3 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] [instance: 4266a63b-9328-4c00-81d2-3583ceb5d080] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:53.679118 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-232a752e-acd5-462b-862f-ad140b0ab5d3 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:53.679577 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-232a752e-acd5-462b-862f-ad140b0ab5d3 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:53.681075 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-232a752e-acd5-462b-862f-ad140b0ab5d3 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:53.681075 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-232a752e-acd5-462b-862f-ad140b0ab5d3 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:53.865732 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-067049c6-4a70-4356-8fbd-0fb4c1134989 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:53.866392 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-067049c6-4a70-4356-8fbd-0fb4c1134989 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] [instance: 990431e1-82cb-42b0-a288-949d79e21762] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:53.874149 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-067049c6-4a70-4356-8fbd-0fb4c1134989 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:53.874322 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-067049c6-4a70-4356-8fbd-0fb4c1134989 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:53.875692 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-067049c6-4a70-4356-8fbd-0fb4c1134989 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:53.876429 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-067049c6-4a70-4356-8fbd-0fb4c1134989 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:53.883852 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-232a752e-acd5-462b-862f-ad140b0ab5d3 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be4bd5c0f2a400da491bae101b48832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515325707f64d58a28f26451b2c74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:53.895652 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-232a752e-acd5-462b-862f-ad140b0ab5d3 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /compute/v2.1/servers/4266a63b-9328-4c00-81d2-3583ceb5d080" status: 200 len: 1317 microversion: 2.1 time: 0.228948 May 26 15:00:53.906161 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 321/610] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:00:53 2021] GET /compute/v2.1/servers/4266a63b-9328-4c00-81d2-3583ceb5d080 => generated 1317 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:00:53.956722 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-6bd5780d-5673-4b88-be47-a74cd379b5f5 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:53.963866 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-6bd5780d-5673-4b88-be47-a74cd379b5f5 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] [instance: 8e4e2075-5a0f-4e15-892d-e4b5eb5b8807] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:53.964001 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-067049c6-4a70-4356-8fbd-0fb4c1134989 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:53.964001 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-067049c6-4a70-4356-8fbd-0fb4c1134989 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:53.964197 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.objects.instance [None req-067049c6-4a70-4356-8fbd-0fb4c1134989 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lazy-loading 'fault' on Instance uuid 990431e1-82cb-42b0-a288-949d79e21762 {{(pid=118514) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 26 15:00:53.965022 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-6bd5780d-5673-4b88-be47-a74cd379b5f5 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:53.974192 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-6bd5780d-5673-4b88-be47-a74cd379b5f5 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:53.975594 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-6bd5780d-5673-4b88-be47-a74cd379b5f5 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:53.976136 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-6bd5780d-5673-4b88-be47-a74cd379b5f5 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:54.036940 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-067049c6-4a70-4356-8fbd-0fb4c1134989 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8604f942d44fec96828cc0b1ae5960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b729993a1944061bb0a708877c95a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:54.049709 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-067049c6-4a70-4356-8fbd-0fb4c1134989 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] 10.222.0.81 "GET /compute/v2.1/servers/990431e1-82cb-42b0-a288-949d79e21762" status: 200 len: 1309 microversion: 2.1 time: 0.190065 May 26 15:00:54.050296 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 290/611] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:00:53 2021] GET /compute/v2.1/servers/990431e1-82cb-42b0-a288-949d79e21762 => generated 1309 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:00:54.214185 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-6bd5780d-5673-4b88-be47-a74cd379b5f5 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96610ea2bcf84875be6d08859dd0c7b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dffd269c3a344d36b77ebb04d0c412e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:54.222268 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-6bd5780d-5673-4b88-be47-a74cd379b5f5 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] 10.222.0.81 "GET /compute/v2.1/servers/8e4e2075-5a0f-4e15-892d-e4b5eb5b8807" status: 200 len: 1314 microversion: 2.1 time: 0.270011 May 26 15:00:54.222823 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 322/612] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:00:53 2021] GET /compute/v2.1/servers/8e4e2075-5a0f-4e15-892d-e4b5eb5b8807 => generated 1314 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:00:54.332799 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-96e0e999-57bf-4f63-b680-123254d2b6d1 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:54.333417 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-96e0e999-57bf-4f63-b680-123254d2b6d1 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] [instance: aa145a33-41b1-4e39-9642-132aca11fcfe] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:54.341502 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-96e0e999-57bf-4f63-b680-123254d2b6d1 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:54.342012 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-96e0e999-57bf-4f63-b680-123254d2b6d1 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:54.342790 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-96e0e999-57bf-4f63-b680-123254d2b6d1 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:54.343236 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-96e0e999-57bf-4f63-b680-123254d2b6d1 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:54.612918 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-96e0e999-57bf-4f63-b680-123254d2b6d1 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b167942c895345b186a3eda5c82175b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad2ab2705ca479ab4aaafe7c80de162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:54.629904 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-5c0f102c-3bdc-4cf2-ac9a-c09539662813 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:54.630537 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-5c0f102c-3bdc-4cf2-ac9a-c09539662813 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] [instance: 29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:54.631141 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-96e0e999-57bf-4f63-b680-123254d2b6d1 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /compute/v2.1/servers/aa145a33-41b1-4e39-9642-132aca11fcfe" status: 200 len: 1561 microversion: 2.1 time: 0.301342 May 26 15:00:54.631933 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 291/613] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:00:54 2021] GET /compute/v2.1/servers/aa145a33-41b1-4e39-9642-132aca11fcfe => generated 1561 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:00:54.638920 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-5c0f102c-3bdc-4cf2-ac9a-c09539662813 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:54.639380 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-5c0f102c-3bdc-4cf2-ac9a-c09539662813 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:54.640175 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-5c0f102c-3bdc-4cf2-ac9a-c09539662813 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:54.640618 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-5c0f102c-3bdc-4cf2-ac9a-c09539662813 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:54.666426 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-1fe346c9-4636-4aa1-9072-37e85907f1d6 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:54.667341 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-1fe346c9-4636-4aa1-9072-37e85907f1d6 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 598b0e3f-8cf1-451a-80a8-ed7e5dd36984] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:54.675707 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-1fe346c9-4636-4aa1-9072-37e85907f1d6 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:54.679571 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-1fe346c9-4636-4aa1-9072-37e85907f1d6 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:54.679571 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-1fe346c9-4636-4aa1-9072-37e85907f1d6 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:54.679571 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-1fe346c9-4636-4aa1-9072-37e85907f1d6 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:54.760107 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-5c0f102c-3bdc-4cf2-ac9a-c09539662813 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565618950dd54005a4a040f4dd0cbb33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c65d1e254f424ebfea8360aa697c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:54.771466 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-5c0f102c-3bdc-4cf2-ac9a-c09539662813 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /compute/v2.1/servers/29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de" status: 200 len: 1187 microversion: 2.1 time: 0.145547 May 26 15:00:54.772138 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 323/614] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:00:54 2021] GET /compute/v2.1/servers/29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de => generated 1187 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:00:54.777844 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-b5eb8f15-abfd-4cb8-96fe-a2e04fce8474 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:54.778411 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-b5eb8f15-abfd-4cb8-96fe-a2e04fce8474 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] [instance: aa145a33-41b1-4e39-9642-132aca11fcfe] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:54.786698 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-b5eb8f15-abfd-4cb8-96fe-a2e04fce8474 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:54.787166 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-b5eb8f15-abfd-4cb8-96fe-a2e04fce8474 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:54.787988 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-b5eb8f15-abfd-4cb8-96fe-a2e04fce8474 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:54.792469 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-b5eb8f15-abfd-4cb8-96fe-a2e04fce8474 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:54.895904 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-1fe346c9-4636-4aa1-9072-37e85907f1d6 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:54.905635 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-1fe346c9-4636-4aa1-9072-37e85907f1d6 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:54.908031 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-1fe346c9-4636-4aa1-9072-37e85907f1d6 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:54.909186 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-1fe346c9-4636-4aa1-9072-37e85907f1d6 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984" status: 200 len: 1807 microversion: 2.20 time: 0.246525 May 26 15:00:54.909780 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 292/615] 10.222.0.81 () {60 vars in 1277 bytes} [Wed May 26 15:00:54 2021] GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984 => generated 1807 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:00:54.913978 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-afbcf848-373b-4b4c-a079-41810e6a106f tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:54.914644 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-afbcf848-373b-4b4c-a079-41810e6a106f tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] [instance: 4266a63b-9328-4c00-81d2-3583ceb5d080] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:54.921960 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-afbcf848-373b-4b4c-a079-41810e6a106f tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:54.922518 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-afbcf848-373b-4b4c-a079-41810e6a106f tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:54.923310 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-afbcf848-373b-4b4c-a079-41810e6a106f tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:54.923754 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-afbcf848-373b-4b4c-a079-41810e6a106f tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:54.970853 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.objects.instance [None req-b5eb8f15-abfd-4cb8-96fe-a2e04fce8474 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lazy-loading 'services' on Instance uuid aa145a33-41b1-4e39-9642-132aca11fcfe {{(pid=118513) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 26 15:00:55.132940 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-afbcf848-373b-4b4c-a079-41810e6a106f tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be4bd5c0f2a400da491bae101b48832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515325707f64d58a28f26451b2c74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:55.141334 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-afbcf848-373b-4b4c-a079-41810e6a106f tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /compute/v2.1/servers/4266a63b-9328-4c00-81d2-3583ceb5d080" status: 200 len: 1317 microversion: 2.1 time: 0.229991 May 26 15:00:55.141947 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 293/616] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:00:54 2021] GET /compute/v2.1/servers/4266a63b-9328-4c00-81d2-3583ceb5d080 => generated 1317 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:00:55.146269 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-3aae9bd7-95b4-4708-96fd-88ceb8232f14 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:55.146883 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-3aae9bd7-95b4-4708-96fd-88ceb8232f14 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] [instance: 990431e1-82cb-42b0-a288-949d79e21762] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:55.157427 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-3aae9bd7-95b4-4708-96fd-88ceb8232f14 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:55.157910 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-3aae9bd7-95b4-4708-96fd-88ceb8232f14 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:55.158691 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-3aae9bd7-95b4-4708-96fd-88ceb8232f14 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:55.159133 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-3aae9bd7-95b4-4708-96fd-88ceb8232f14 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:55.208017 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.wsgi [None req-3aae9bd7-95b4-4708-96fd-88ceb8232f14 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] HTTP exception thrown: Instance 990431e1-82cb-42b0-a288-949d79e21762 could not be found. May 26 15:00:55.208527 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-3aae9bd7-95b4-4708-96fd-88ceb8232f14 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Returning 404 to user: Instance 990431e1-82cb-42b0-a288-949d79e21762 could not be found. {{(pid=118514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 26 15:00:55.209372 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-3aae9bd7-95b4-4708-96fd-88ceb8232f14 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] 10.222.0.81 "GET /compute/v2.1/servers/990431e1-82cb-42b0-a288-949d79e21762" status: 404 len: 111 microversion: 2.1 time: 0.066501 May 26 15:00:55.209965 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 294/617] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:00:55 2021] GET /compute/v2.1/servers/990431e1-82cb-42b0-a288-949d79e21762 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 15:00:55.219849 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-b5eb8f15-abfd-4cb8-96fe-a2e04fce8474 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "DELETE /compute/v2.1/servers/aa145a33-41b1-4e39-9642-132aca11fcfe/os-volume_attachments/f0feefca-b280-4489-8686-ba0694fc3620" status: 202 len: 0 microversion: 2.1 time: 0.445430 May 26 15:00:55.220783 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 324/618] 10.222.0.81 () {58 vars in 1416 bytes} [Wed May 26 15:00:54 2021] DELETE /compute/v2.1/servers/aa145a33-41b1-4e39-9642-132aca11fcfe/os-volume_attachments/f0feefca-b280-4489-8686-ba0694fc3620 => generated 0 bytes in 447 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 15:00:55.240166 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-16a94437-700c-4652-9928-864be09e7b1a tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:55.240802 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-16a94437-700c-4652-9928-864be09e7b1a tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] [instance: 8e4e2075-5a0f-4e15-892d-e4b5eb5b8807] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:55.249419 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-16a94437-700c-4652-9928-864be09e7b1a tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:55.261121 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-16a94437-700c-4652-9928-864be09e7b1a tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:55.261121 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-16a94437-700c-4652-9928-864be09e7b1a tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:55.261121 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-16a94437-700c-4652-9928-864be09e7b1a tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:55.499634 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-16a94437-700c-4652-9928-864be09e7b1a tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96610ea2bcf84875be6d08859dd0c7b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dffd269c3a344d36b77ebb04d0c412e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:55.517113 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-16a94437-700c-4652-9928-864be09e7b1a tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] 10.222.0.81 "GET /compute/v2.1/servers/8e4e2075-5a0f-4e15-892d-e4b5eb5b8807" status: 200 len: 1314 microversion: 2.1 time: 0.282171 May 26 15:00:55.527580 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 295/619] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:00:55 2021] GET /compute/v2.1/servers/8e4e2075-5a0f-4e15-892d-e4b5eb5b8807 => generated 1314 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:00:55.792674 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-a90b2976-78fc-4884-bd21-dd50209b3813 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:55.792674 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-a90b2976-78fc-4884-bd21-dd50209b3813 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] [instance: 29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:55.804122 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-a90b2976-78fc-4884-bd21-dd50209b3813 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:55.805324 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-a90b2976-78fc-4884-bd21-dd50209b3813 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:55.805324 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-a90b2976-78fc-4884-bd21-dd50209b3813 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:55.813923 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-a90b2976-78fc-4884-bd21-dd50209b3813 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:55.933978 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-fd70a250-6475-4282-b6f6-600a7ddb9f1c tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:55.936131 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-fd70a250-6475-4282-b6f6-600a7ddb9f1c tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 598b0e3f-8cf1-451a-80a8-ed7e5dd36984] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:55.956406 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-fd70a250-6475-4282-b6f6-600a7ddb9f1c tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:55.957001 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-fd70a250-6475-4282-b6f6-600a7ddb9f1c tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:55.959206 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-fd70a250-6475-4282-b6f6-600a7ddb9f1c tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:55.959852 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-fd70a250-6475-4282-b6f6-600a7ddb9f1c tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:56.163813 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-a90b2976-78fc-4884-bd21-dd50209b3813 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565618950dd54005a4a040f4dd0cbb33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c65d1e254f424ebfea8360aa697c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:56.173229 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-a90b2976-78fc-4884-bd21-dd50209b3813 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /compute/v2.1/servers/29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de" status: 200 len: 1205 microversion: 2.1 time: 0.387619 May 26 15:00:56.174096 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 325/620] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:00:55 2021] GET /compute/v2.1/servers/29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de => generated 1205 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:00:56.179192 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-e2cb29b3-0bd6-4cc4-a7e5-09019cd1d972 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:56.180050 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-e2cb29b3-0bd6-4cc4-a7e5-09019cd1d972 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] [instance: 4266a63b-9328-4c00-81d2-3583ceb5d080] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:56.188681 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-e2cb29b3-0bd6-4cc4-a7e5-09019cd1d972 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:56.189476 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-e2cb29b3-0bd6-4cc4-a7e5-09019cd1d972 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:56.190687 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-e2cb29b3-0bd6-4cc4-a7e5-09019cd1d972 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:56.191087 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-fd70a250-6475-4282-b6f6-600a7ddb9f1c tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:56.191675 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-e2cb29b3-0bd6-4cc4-a7e5-09019cd1d972 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:56.205707 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-fd70a250-6475-4282-b6f6-600a7ddb9f1c tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:56.208831 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-fd70a250-6475-4282-b6f6-600a7ddb9f1c tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:56.210192 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-fd70a250-6475-4282-b6f6-600a7ddb9f1c tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984" status: 200 len: 1807 microversion: 2.20 time: 0.284637 May 26 15:00:56.221587 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 296/621] 10.222.0.81 () {60 vars in 1277 bytes} [Wed May 26 15:00:55 2021] GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984 => generated 1807 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:00:56.535247 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-d4856b62-ecce-488c-9125-fa0062ac9c9d tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:56.536053 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-d4856b62-ecce-488c-9125-fa0062ac9c9d tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] [instance: 8e4e2075-5a0f-4e15-892d-e4b5eb5b8807] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:56.544178 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-d4856b62-ecce-488c-9125-fa0062ac9c9d tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:56.544739 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-d4856b62-ecce-488c-9125-fa0062ac9c9d tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:56.545676 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-d4856b62-ecce-488c-9125-fa0062ac9c9d tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:56.546228 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-d4856b62-ecce-488c-9125-fa0062ac9c9d tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:56.575383 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-e2cb29b3-0bd6-4cc4-a7e5-09019cd1d972 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be4bd5c0f2a400da491bae101b48832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515325707f64d58a28f26451b2c74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:56.584135 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-e2cb29b3-0bd6-4cc4-a7e5-09019cd1d972 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /compute/v2.1/servers/4266a63b-9328-4c00-81d2-3583ceb5d080" status: 200 len: 1508 microversion: 2.1 time: 0.408842 May 26 15:00:56.585229 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 326/622] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:00:56 2021] GET /compute/v2.1/servers/4266a63b-9328-4c00-81d2-3583ceb5d080 => generated 1508 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:00:56.763738 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-d4856b62-ecce-488c-9125-fa0062ac9c9d tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96610ea2bcf84875be6d08859dd0c7b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dffd269c3a344d36b77ebb04d0c412e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:56.772949 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-d4856b62-ecce-488c-9125-fa0062ac9c9d tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] 10.222.0.81 "GET /compute/v2.1/servers/8e4e2075-5a0f-4e15-892d-e4b5eb5b8807" status: 200 len: 1499 microversion: 2.1 time: 0.242090 May 26 15:00:56.777050 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 297/623] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:00:56 2021] GET /compute/v2.1/servers/8e4e2075-5a0f-4e15-892d-e4b5eb5b8807 => generated 1499 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:00:57.192518 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-59850aca-97ca-4a53-9247-c4761654bfd7 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:57.192518 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-59850aca-97ca-4a53-9247-c4761654bfd7 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] [instance: 29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:57.200759 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-59850aca-97ca-4a53-9247-c4761654bfd7 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:57.200759 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-59850aca-97ca-4a53-9247-c4761654bfd7 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:57.200759 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-59850aca-97ca-4a53-9247-c4761654bfd7 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:57.200759 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-59850aca-97ca-4a53-9247-c4761654bfd7 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:57.231146 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-019916c1-bd17-4e7d-9818-4a9b2eae8055 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:57.232371 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-019916c1-bd17-4e7d-9818-4a9b2eae8055 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 598b0e3f-8cf1-451a-80a8-ed7e5dd36984] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:57.248761 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-019916c1-bd17-4e7d-9818-4a9b2eae8055 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:57.249407 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-019916c1-bd17-4e7d-9818-4a9b2eae8055 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:57.253724 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-019916c1-bd17-4e7d-9818-4a9b2eae8055 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:57.254355 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-019916c1-bd17-4e7d-9818-4a9b2eae8055 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:57.473481 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-019916c1-bd17-4e7d-9818-4a9b2eae8055 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:57.482959 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-019916c1-bd17-4e7d-9818-4a9b2eae8055 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:57.485035 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-019916c1-bd17-4e7d-9818-4a9b2eae8055 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:57.486335 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-019916c1-bd17-4e7d-9818-4a9b2eae8055 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984" status: 200 len: 1807 microversion: 2.20 time: 0.259936 May 26 15:00:57.486897 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 298/624] 10.222.0.81 () {60 vars in 1277 bytes} [Wed May 26 15:00:57 2021] GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984 => generated 1807 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:00:57.491638 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-59850aca-97ca-4a53-9247-c4761654bfd7 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565618950dd54005a4a040f4dd0cbb33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c65d1e254f424ebfea8360aa697c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:57.501162 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-59850aca-97ca-4a53-9247-c4761654bfd7 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /compute/v2.1/servers/29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de" status: 200 len: 1273 microversion: 2.1 time: 0.313504 May 26 15:00:57.501845 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 327/625] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:00:57 2021] GET /compute/v2.1/servers/29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de => generated 1273 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:00:58.504461 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-1035f48a-4f31-4111-ba46-791d3d643ec7 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:58.505110 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-1035f48a-4f31-4111-ba46-791d3d643ec7 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 598b0e3f-8cf1-451a-80a8-ed7e5dd36984] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:58.512521 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-1035f48a-4f31-4111-ba46-791d3d643ec7 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:58.512978 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-1035f48a-4f31-4111-ba46-791d3d643ec7 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:58.513798 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-1035f48a-4f31-4111-ba46-791d3d643ec7 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:58.514246 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-1035f48a-4f31-4111-ba46-791d3d643ec7 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:58.522695 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-898bc5d5-d583-46dd-a437-4fb2f6e08cb3 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:58.523316 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-898bc5d5-d583-46dd-a437-4fb2f6e08cb3 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] [instance: 29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:58.530803 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-898bc5d5-d583-46dd-a437-4fb2f6e08cb3 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:58.531299 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-898bc5d5-d583-46dd-a437-4fb2f6e08cb3 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:58.532074 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-898bc5d5-d583-46dd-a437-4fb2f6e08cb3 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:58.532977 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-898bc5d5-d583-46dd-a437-4fb2f6e08cb3 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:58.711879 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-1035f48a-4f31-4111-ba46-791d3d643ec7 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:58.721960 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-1035f48a-4f31-4111-ba46-791d3d643ec7 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:58.723485 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-1035f48a-4f31-4111-ba46-791d3d643ec7 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:58.724633 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-1035f48a-4f31-4111-ba46-791d3d643ec7 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984" status: 200 len: 1807 microversion: 2.20 time: 0.223903 May 26 15:00:58.725196 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 299/626] 10.222.0.81 () {60 vars in 1277 bytes} [Wed May 26 15:00:58 2021] GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984 => generated 1807 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:00:58.732085 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-898bc5d5-d583-46dd-a437-4fb2f6e08cb3 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565618950dd54005a4a040f4dd0cbb33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c65d1e254f424ebfea8360aa697c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:00:58.741087 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-898bc5d5-d583-46dd-a437-4fb2f6e08cb3 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /compute/v2.1/servers/29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de" status: 200 len: 1273 microversion: 2.1 time: 0.222001 May 26 15:00:58.741666 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 328/627] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:00:58 2021] GET /compute/v2.1/servers/29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de => generated 1273 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:00:59.743329 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-273ac3fe-adbe-4108-aa44-92b0559a562c tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:59.743957 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-273ac3fe-adbe-4108-aa44-92b0559a562c tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 598b0e3f-8cf1-451a-80a8-ed7e5dd36984] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:59.753285 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-273ac3fe-adbe-4108-aa44-92b0559a562c tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:59.754006 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-273ac3fe-adbe-4108-aa44-92b0559a562c tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:59.754852 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-273ac3fe-adbe-4108-aa44-92b0559a562c tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:59.755584 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-273ac3fe-adbe-4108-aa44-92b0559a562c tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:59.759979 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-76c5b546-d27d-4caf-a45d-e7f17a8e9da9 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:00:59.760603 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-76c5b546-d27d-4caf-a45d-e7f17a8e9da9 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] [instance: 29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:00:59.770110 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-76c5b546-d27d-4caf-a45d-e7f17a8e9da9 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:59.770562 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-76c5b546-d27d-4caf-a45d-e7f17a8e9da9 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:00:59.771423 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-76c5b546-d27d-4caf-a45d-e7f17a8e9da9 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:00:59.771795 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-76c5b546-d27d-4caf-a45d-e7f17a8e9da9 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:00.019732 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-273ac3fe-adbe-4108-aa44-92b0559a562c tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:01:00.034243 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-273ac3fe-adbe-4108-aa44-92b0559a562c tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:01:00.037151 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-273ac3fe-adbe-4108-aa44-92b0559a562c tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:01:00.038735 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-273ac3fe-adbe-4108-aa44-92b0559a562c tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984" status: 200 len: 1807 microversion: 2.20 time: 0.299844 May 26 15:01:00.039570 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 300/628] 10.222.0.81 () {60 vars in 1277 bytes} [Wed May 26 15:00:59 2021] GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984 => generated 1807 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:01:00.390104 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-76c5b546-d27d-4caf-a45d-e7f17a8e9da9 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565618950dd54005a4a040f4dd0cbb33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c65d1e254f424ebfea8360aa697c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:01:00.399113 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-76c5b546-d27d-4caf-a45d-e7f17a8e9da9 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /compute/v2.1/servers/29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de" status: 200 len: 1273 microversion: 2.1 time: 0.643991 May 26 15:01:00.399673 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 329/629] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:00:59 2021] GET /compute/v2.1/servers/29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de => generated 1273 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:01:00.484107 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-4a74b8ed-d513-4f32-81f8-fb319e53880b tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:00.484642 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-4a74b8ed-d513-4f32-81f8-fb319e53880b tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] [instance: 8e4e2075-5a0f-4e15-892d-e4b5eb5b8807] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:01:00.492185 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-4a74b8ed-d513-4f32-81f8-fb319e53880b tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:00.492914 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-4a74b8ed-d513-4f32-81f8-fb319e53880b tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:00.498075 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-4a74b8ed-d513-4f32-81f8-fb319e53880b tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:00.498075 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-4a74b8ed-d513-4f32-81f8-fb319e53880b tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:00.559493 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-4a74b8ed-d513-4f32-81f8-fb319e53880b tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] [instance: 8e4e2075-5a0f-4e15-892d-e4b5eb5b8807] Going to try to terminate instance {{(pid=118514) delete /opt/stack/nova/nova/compute/api.py:2539}} May 26 15:01:00.566493 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [req-0500d1e6-0021-4223-b6fe-572ceb36e3ef req-6fbee3fa-c25c-4924-8e1f-c19f2d5a0903 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de", "tag": "24388d3c-fd02-41f5-996a-da7452902c2b"}]} {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:01:00.568480 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 15:01:00.568480 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: warnings.warn(msg) May 26 15:01:00.581636 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [req-0500d1e6-0021-4223-b6fe-572ceb36e3ef req-6fbee3fa-c25c-4924-8e1f-c19f2d5a0903 service nova] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:00.588834 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [req-0500d1e6-0021-4223-b6fe-572ceb36e3ef req-6fbee3fa-c25c-4924-8e1f-c19f2d5a0903 service nova] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:00.604916 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.compute.server_external_events [req-0500d1e6-0021-4223-b6fe-572ceb36e3ef req-6fbee3fa-c25c-4924-8e1f-c19f2d5a0903 service nova] Creating event network-changed:24388d3c-fd02-41f5-996a-da7452902c2b for instance 29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de on hv-cinder-78414 May 26 15:01:00.610193 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [req-0500d1e6-0021-4223-b6fe-572ceb36e3ef req-6fbee3fa-c25c-4924-8e1f-c19f2d5a0903 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048079 May 26 15:01:00.610782 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 330/630] 10.222.0.81 () {64 vars in 1318 bytes} [Wed May 26 15:01:00 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 15:01:00.809732 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-0065dcad-ad33-4d0e-a8b0-5f4d07b171e5 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8f312ac5-0f9f-4ddd-8fdc-5b18a3bc4a2d"}} {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:01:00.810833 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-0065dcad-ad33-4d0e-a8b0-5f4d07b171e5 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] [instance: 4266a63b-9328-4c00-81d2-3583ceb5d080] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:01:00.821331 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-0065dcad-ad33-4d0e-a8b0-5f4d07b171e5 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:00.822194 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-0065dcad-ad33-4d0e-a8b0-5f4d07b171e5 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:00.823161 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-0065dcad-ad33-4d0e-a8b0-5f4d07b171e5 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:00.823762 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-0065dcad-ad33-4d0e-a8b0-5f4d07b171e5 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:00.905286 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-4a74b8ed-d513-4f32-81f8-fb319e53880b tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] 10.222.0.81 "DELETE /compute/v2.1/servers/8e4e2075-5a0f-4e15-892d-e4b5eb5b8807" status: 204 len: 0 microversion: 2.1 time: 0.424503 May 26 15:01:00.906186 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 301/631] 10.222.0.81 () {58 vars in 1239 bytes} [Wed May 26 15:01:00 2021] DELETE /compute/v2.1/servers/8e4e2075-5a0f-4e15-892d-e4b5eb5b8807 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 15:01:00.915193 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-b4fdc725-2b7c-4232-9dc2-6b21b830a129 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:00.916058 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-b4fdc725-2b7c-4232-9dc2-6b21b830a129 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] [instance: 8e4e2075-5a0f-4e15-892d-e4b5eb5b8807] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:01:00.926868 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-b4fdc725-2b7c-4232-9dc2-6b21b830a129 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:00.927656 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-b4fdc725-2b7c-4232-9dc2-6b21b830a129 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:00.928708 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-b4fdc725-2b7c-4232-9dc2-6b21b830a129 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:00.929528 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-b4fdc725-2b7c-4232-9dc2-6b21b830a129 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:01.311541 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-b4fdc725-2b7c-4232-9dc2-6b21b830a129 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96610ea2bcf84875be6d08859dd0c7b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dffd269c3a344d36b77ebb04d0c412e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:01:01.324366 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-b4fdc725-2b7c-4232-9dc2-6b21b830a129 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] 10.222.0.81 "GET /compute/v2.1/servers/8e4e2075-5a0f-4e15-892d-e4b5eb5b8807" status: 200 len: 1505 microversion: 2.1 time: 0.409182 May 26 15:01:01.324366 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 302/632] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:01:00 2021] GET /compute/v2.1/servers/8e4e2075-5a0f-4e15-892d-e4b5eb5b8807 => generated 1505 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:01:01.325731 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-eb374499-7f0f-46d7-8178-405f728bdb5d tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:01.326586 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-eb374499-7f0f-46d7-8178-405f728bdb5d tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 598b0e3f-8cf1-451a-80a8-ed7e5dd36984] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:01:01.335102 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-eb374499-7f0f-46d7-8178-405f728bdb5d tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:01.335815 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-eb374499-7f0f-46d7-8178-405f728bdb5d tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:01.336909 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-eb374499-7f0f-46d7-8178-405f728bdb5d tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:01.337574 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-eb374499-7f0f-46d7-8178-405f728bdb5d tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:01.819392 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-eb374499-7f0f-46d7-8178-405f728bdb5d tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:01:01.829174 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-eb374499-7f0f-46d7-8178-405f728bdb5d tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:01:01.832287 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-eb374499-7f0f-46d7-8178-405f728bdb5d tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:01:01.832287 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-eb374499-7f0f-46d7-8178-405f728bdb5d tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984" status: 200 len: 1807 microversion: 2.20 time: 0.510026 May 26 15:01:01.838999 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 303/633] 10.222.0.81 () {60 vars in 1277 bytes} [Wed May 26 15:01:01 2021] GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984 => generated 1807 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:01:01.844286 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-f0e09799-894b-4a7d-a226-bfd6f087bee2 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:01.845145 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-f0e09799-894b-4a7d-a226-bfd6f087bee2 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] [instance: 29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:01:01.857271 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-f0e09799-894b-4a7d-a226-bfd6f087bee2 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:01.857271 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-f0e09799-894b-4a7d-a226-bfd6f087bee2 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:01.857271 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-f0e09799-894b-4a7d-a226-bfd6f087bee2 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:01.857271 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-f0e09799-894b-4a7d-a226-bfd6f087bee2 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:02.189114 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-f0e09799-894b-4a7d-a226-bfd6f087bee2 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565618950dd54005a4a040f4dd0cbb33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c65d1e254f424ebfea8360aa697c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:01:02.197713 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-f0e09799-894b-4a7d-a226-bfd6f087bee2 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /compute/v2.1/servers/29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de" status: 200 len: 1273 microversion: 2.1 time: 0.357530 May 26 15:01:02.198307 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 304/634] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:01:01 2021] GET /compute/v2.1/servers/29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de => generated 1273 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:01:02.224859 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-0065dcad-ad33-4d0e-a8b0-5f4d07b171e5 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "POST /compute/v2.1/servers/4266a63b-9328-4c00-81d2-3583ceb5d080/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.419484 May 26 15:01:02.227101 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 331/635] 10.222.0.81 () {60 vars in 1323 bytes} [Wed May 26 15:01:00 2021] POST /compute/v2.1/servers/4266a63b-9328-4c00-81d2-3583ceb5d080/os-volume_attachments => generated 194 bytes in 1422 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:01:02.337572 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-ad646721-b526-4098-8684-d5d8b1634de8 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:02.338189 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-ad646721-b526-4098-8684-d5d8b1634de8 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] [instance: 8e4e2075-5a0f-4e15-892d-e4b5eb5b8807] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:01:02.345392 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-ad646721-b526-4098-8684-d5d8b1634de8 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:02.345888 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-ad646721-b526-4098-8684-d5d8b1634de8 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:02.346666 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-ad646721-b526-4098-8684-d5d8b1634de8 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:02.347109 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-ad646721-b526-4098-8684-d5d8b1634de8 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:02.557260 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-ad646721-b526-4098-8684-d5d8b1634de8 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96610ea2bcf84875be6d08859dd0c7b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dffd269c3a344d36b77ebb04d0c412e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:01:02.566471 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-ad646721-b526-4098-8684-d5d8b1634de8 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] 10.222.0.81 "GET /compute/v2.1/servers/8e4e2075-5a0f-4e15-892d-e4b5eb5b8807" status: 200 len: 1505 microversion: 2.1 time: 0.232634 May 26 15:01:02.567045 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 305/636] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:01:02 2021] GET /compute/v2.1/servers/8e4e2075-5a0f-4e15-892d-e4b5eb5b8807 => generated 1505 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:01:02.851264 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-3bd341ed-babc-4da6-a8f2-1ab9f21b2331 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:02.851964 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-3bd341ed-babc-4da6-a8f2-1ab9f21b2331 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 598b0e3f-8cf1-451a-80a8-ed7e5dd36984] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:01:02.860595 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-3bd341ed-babc-4da6-a8f2-1ab9f21b2331 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:02.865330 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-3bd341ed-babc-4da6-a8f2-1ab9f21b2331 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:02.865330 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-3bd341ed-babc-4da6-a8f2-1ab9f21b2331 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:02.865330 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-3bd341ed-babc-4da6-a8f2-1ab9f21b2331 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:03.063125 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-3bd341ed-babc-4da6-a8f2-1ab9f21b2331 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:01:03.072392 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-3bd341ed-babc-4da6-a8f2-1ab9f21b2331 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:01:03.073921 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-3bd341ed-babc-4da6-a8f2-1ab9f21b2331 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:01:03.075086 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-3bd341ed-babc-4da6-a8f2-1ab9f21b2331 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984" status: 200 len: 1807 microversion: 2.20 time: 0.227897 May 26 15:01:03.075635 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 332/637] 10.222.0.81 () {60 vars in 1277 bytes} [Wed May 26 15:01:02 2021] GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984 => generated 1807 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 15:01:03.215007 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-5882f641-c29a-4f33-b674-d8978eb3cb34 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:03.215768 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-5882f641-c29a-4f33-b674-d8978eb3cb34 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] [instance: 29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:01:03.224479 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-5882f641-c29a-4f33-b674-d8978eb3cb34 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:03.228811 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-5882f641-c29a-4f33-b674-d8978eb3cb34 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:03.228811 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-5882f641-c29a-4f33-b674-d8978eb3cb34 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:03.228811 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-5882f641-c29a-4f33-b674-d8978eb3cb34 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:03.585272 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-af8b1097-bd57-4458-b388-642f7a47b141 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:03.585940 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-af8b1097-bd57-4458-b388-642f7a47b141 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] [instance: 8e4e2075-5a0f-4e15-892d-e4b5eb5b8807] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:01:03.598332 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-af8b1097-bd57-4458-b388-642f7a47b141 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:03.599264 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-af8b1097-bd57-4458-b388-642f7a47b141 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:03.601015 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-af8b1097-bd57-4458-b388-642f7a47b141 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:03.601493 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-af8b1097-bd57-4458-b388-642f7a47b141 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:03.634505 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-5882f641-c29a-4f33-b674-d8978eb3cb34 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565618950dd54005a4a040f4dd0cbb33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c65d1e254f424ebfea8360aa697c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:01:03.659129 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-5882f641-c29a-4f33-b674-d8978eb3cb34 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /compute/v2.1/servers/29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de" status: 200 len: 1261 microversion: 2.1 time: 0.447673 May 26 15:01:03.659750 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 306/638] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:01:03 2021] GET /compute/v2.1/servers/29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de => generated 1261 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:01:03.732744 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-af8b1097-bd57-4458-b388-642f7a47b141 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96610ea2bcf84875be6d08859dd0c7b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dffd269c3a344d36b77ebb04d0c412e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:01:03.743700 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-af8b1097-bd57-4458-b388-642f7a47b141 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] 10.222.0.81 "GET /compute/v2.1/servers/8e4e2075-5a0f-4e15-892d-e4b5eb5b8807" status: 200 len: 1463 microversion: 2.1 time: 0.162874 May 26 15:01:03.747583 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 333/639] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:01:03 2021] GET /compute/v2.1/servers/8e4e2075-5a0f-4e15-892d-e4b5eb5b8807 => generated 1463 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:01:03.880922 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [req-a404aac5-abbf-4957-a587-f79b27ca36fa req-666fa658-44ea-4e45-80fc-5361aa612a05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e4e2075-5a0f-4e15-892d-e4b5eb5b8807", "name": "network-vif-deleted", "tag": "e2b86960-bb59-4f27-9951-ec442358a17d"}]} {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:01:03.882568 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 15:01:03.882568 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: warnings.warn(msg) May 26 15:01:03.891382 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [req-a404aac5-abbf-4957-a587-f79b27ca36fa req-666fa658-44ea-4e45-80fc-5361aa612a05 service nova] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:03.891831 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [req-a404aac5-abbf-4957-a587-f79b27ca36fa req-666fa658-44ea-4e45-80fc-5361aa612a05 service nova] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:03.907668 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.compute.server_external_events [req-a404aac5-abbf-4957-a587-f79b27ca36fa req-666fa658-44ea-4e45-80fc-5361aa612a05 service nova] Creating event network-vif-deleted:e2b86960-bb59-4f27-9951-ec442358a17d for instance 8e4e2075-5a0f-4e15-892d-e4b5eb5b8807 on hv-cinder-78414 May 26 15:01:03.912357 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [req-a404aac5-abbf-4957-a587-f79b27ca36fa req-666fa658-44ea-4e45-80fc-5361aa612a05 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038678 May 26 15:01:03.912959 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 307/640] 10.222.0.81 () {64 vars in 1318 bytes} [Wed May 26 15:01:03 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:01:04.092810 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-d9d45ab1-032a-4745-b774-6ba0c6704526 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:04.093366 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-d9d45ab1-032a-4745-b774-6ba0c6704526 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 598b0e3f-8cf1-451a-80a8-ed7e5dd36984] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:01:04.100772 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-d9d45ab1-032a-4745-b774-6ba0c6704526 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:04.101226 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-d9d45ab1-032a-4745-b774-6ba0c6704526 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:04.102036 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-d9d45ab1-032a-4745-b774-6ba0c6704526 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:04.102514 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-d9d45ab1-032a-4745-b774-6ba0c6704526 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:04.302674 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-d9d45ab1-032a-4745-b774-6ba0c6704526 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:01:04.311863 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-d9d45ab1-032a-4745-b774-6ba0c6704526 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:01:04.314986 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-d9d45ab1-032a-4745-b774-6ba0c6704526 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:01:04.314986 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-d9d45ab1-032a-4745-b774-6ba0c6704526 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984" status: 200 len: 1807 microversion: 2.20 time: 0.225657 May 26 15:01:04.315184 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 334/641] 10.222.0.81 () {60 vars in 1277 bytes} [Wed May 26 15:01:04 2021] GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984 => generated 1807 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 15:01:04.676404 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-85861492-e578-4ece-95f3-a1ea834c525b tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:04.677117 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-85861492-e578-4ece-95f3-a1ea834c525b tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] [instance: 29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:01:04.686490 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-85861492-e578-4ece-95f3-a1ea834c525b tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:04.687001 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-85861492-e578-4ece-95f3-a1ea834c525b tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:04.687948 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-85861492-e578-4ece-95f3-a1ea834c525b tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:04.688395 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-85861492-e578-4ece-95f3-a1ea834c525b tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:04.760875 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-86839551-6118-49ca-9cb5-26691cad610f tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:04.761563 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-86839551-6118-49ca-9cb5-26691cad610f tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] [instance: 8e4e2075-5a0f-4e15-892d-e4b5eb5b8807] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:01:04.769494 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-86839551-6118-49ca-9cb5-26691cad610f tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:04.769985 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-86839551-6118-49ca-9cb5-26691cad610f tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:04.770767 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-86839551-6118-49ca-9cb5-26691cad610f tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:04.771205 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-86839551-6118-49ca-9cb5-26691cad610f tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:04.884800 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-86839551-6118-49ca-9cb5-26691cad610f tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96610ea2bcf84875be6d08859dd0c7b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dffd269c3a344d36b77ebb04d0c412e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:01:04.891683 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-85861492-e578-4ece-95f3-a1ea834c525b tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565618950dd54005a4a040f4dd0cbb33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c65d1e254f424ebfea8360aa697c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:01:04.894052 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-86839551-6118-49ca-9cb5-26691cad610f tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] 10.222.0.81 "GET /compute/v2.1/servers/8e4e2075-5a0f-4e15-892d-e4b5eb5b8807" status: 200 len: 1463 microversion: 2.1 time: 0.136683 May 26 15:01:04.894635 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 335/642] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:01:04 2021] GET /compute/v2.1/servers/8e4e2075-5a0f-4e15-892d-e4b5eb5b8807 => generated 1463 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:01:04.899864 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-85861492-e578-4ece-95f3-a1ea834c525b tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /compute/v2.1/servers/29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de" status: 200 len: 1261 microversion: 2.1 time: 0.227599 May 26 15:01:04.900682 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 308/643] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:01:04 2021] GET /compute/v2.1/servers/29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de => generated 1261 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:01:05.332788 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-c1b9276a-27e9-4879-a598-6849517f35bc tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:05.333443 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-c1b9276a-27e9-4879-a598-6849517f35bc tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 598b0e3f-8cf1-451a-80a8-ed7e5dd36984] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:01:05.340749 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-c1b9276a-27e9-4879-a598-6849517f35bc tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:05.341200 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-c1b9276a-27e9-4879-a598-6849517f35bc tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:05.341998 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-c1b9276a-27e9-4879-a598-6849517f35bc tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:05.342433 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-c1b9276a-27e9-4879-a598-6849517f35bc tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:05.539520 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-c1b9276a-27e9-4879-a598-6849517f35bc tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:01:05.549074 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-c1b9276a-27e9-4879-a598-6849517f35bc tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:01:05.550555 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-c1b9276a-27e9-4879-a598-6849517f35bc tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:01:05.552085 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-c1b9276a-27e9-4879-a598-6849517f35bc tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984" status: 200 len: 1807 microversion: 2.20 time: 0.223257 May 26 15:01:05.552648 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 336/644] 10.222.0.81 () {60 vars in 1277 bytes} [Wed May 26 15:01:05 2021] GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984 => generated 1807 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:01:05.910814 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-8c423b98-2486-4f99-8425-b9a2fe1aecc3 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:05.911444 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-8c423b98-2486-4f99-8425-b9a2fe1aecc3 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] [instance: 8e4e2075-5a0f-4e15-892d-e4b5eb5b8807] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:01:05.916738 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-da7b9e55-8cb2-4e2c-ab78-407dfb75788f tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:05.917351 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-da7b9e55-8cb2-4e2c-ab78-407dfb75788f tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] [instance: 29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:01:05.918923 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-8c423b98-2486-4f99-8425-b9a2fe1aecc3 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:05.919380 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-8c423b98-2486-4f99-8425-b9a2fe1aecc3 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:05.920168 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-8c423b98-2486-4f99-8425-b9a2fe1aecc3 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:05.920606 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-8c423b98-2486-4f99-8425-b9a2fe1aecc3 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:05.925731 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-da7b9e55-8cb2-4e2c-ab78-407dfb75788f tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:05.926187 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-da7b9e55-8cb2-4e2c-ab78-407dfb75788f tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:05.926984 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-da7b9e55-8cb2-4e2c-ab78-407dfb75788f tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:05.927420 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-da7b9e55-8cb2-4e2c-ab78-407dfb75788f tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:06.108319 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-8c423b98-2486-4f99-8425-b9a2fe1aecc3 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96610ea2bcf84875be6d08859dd0c7b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dffd269c3a344d36b77ebb04d0c412e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:01:06.117518 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-8c423b98-2486-4f99-8425-b9a2fe1aecc3 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] 10.222.0.81 "GET /compute/v2.1/servers/8e4e2075-5a0f-4e15-892d-e4b5eb5b8807" status: 200 len: 1463 microversion: 2.1 time: 0.210368 May 26 15:01:06.118125 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 309/645] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:01:05 2021] GET /compute/v2.1/servers/8e4e2075-5a0f-4e15-892d-e4b5eb5b8807 => generated 1463 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:01:06.128774 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-da7b9e55-8cb2-4e2c-ab78-407dfb75788f tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565618950dd54005a4a040f4dd0cbb33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c65d1e254f424ebfea8360aa697c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:01:06.137118 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-da7b9e55-8cb2-4e2c-ab78-407dfb75788f tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /compute/v2.1/servers/29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de" status: 200 len: 1261 microversion: 2.1 time: 0.224113 May 26 15:01:06.137702 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 337/646] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:01:05 2021] GET /compute/v2.1/servers/29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de => generated 1261 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:01:06.571317 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-67a95942-d8cf-4e16-ac19-2c763ad0910e tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:06.571978 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-67a95942-d8cf-4e16-ac19-2c763ad0910e tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 598b0e3f-8cf1-451a-80a8-ed7e5dd36984] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:01:06.580241 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-67a95942-d8cf-4e16-ac19-2c763ad0910e tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:06.580692 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-67a95942-d8cf-4e16-ac19-2c763ad0910e tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:06.581456 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-67a95942-d8cf-4e16-ac19-2c763ad0910e tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:06.581968 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-67a95942-d8cf-4e16-ac19-2c763ad0910e tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:06.777672 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-67a95942-d8cf-4e16-ac19-2c763ad0910e tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:01:06.786910 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-67a95942-d8cf-4e16-ac19-2c763ad0910e tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:01:06.788461 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-67a95942-d8cf-4e16-ac19-2c763ad0910e tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:01:06.789704 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-67a95942-d8cf-4e16-ac19-2c763ad0910e tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984" status: 200 len: 1807 microversion: 2.20 time: 0.222280 May 26 15:01:06.790268 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 310/647] 10.222.0.81 () {60 vars in 1277 bytes} [Wed May 26 15:01:06 2021] GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984 => generated 1807 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:01:07.135108 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-37cbe785-0f47-4fb1-b640-819bd3a187f1 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:07.135745 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-37cbe785-0f47-4fb1-b640-819bd3a187f1 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] [instance: 8e4e2075-5a0f-4e15-892d-e4b5eb5b8807] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:01:07.143603 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-37cbe785-0f47-4fb1-b640-819bd3a187f1 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:07.144057 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-37cbe785-0f47-4fb1-b640-819bd3a187f1 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:07.144879 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-37cbe785-0f47-4fb1-b640-819bd3a187f1 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:07.145435 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-37cbe785-0f47-4fb1-b640-819bd3a187f1 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:07.154718 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-f115bb5b-276c-43d6-88c1-113770789eb8 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:07.162058 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-f115bb5b-276c-43d6-88c1-113770789eb8 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] [instance: 29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:01:07.163564 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-f115bb5b-276c-43d6-88c1-113770789eb8 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:07.164017 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-f115bb5b-276c-43d6-88c1-113770789eb8 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:07.164792 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-f115bb5b-276c-43d6-88c1-113770789eb8 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:07.165253 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-f115bb5b-276c-43d6-88c1-113770789eb8 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:07.214387 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-37cbe785-0f47-4fb1-b640-819bd3a187f1 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:07.214847 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-37cbe785-0f47-4fb1-b640-819bd3a187f1 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:07.215299 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.objects.instance [None req-37cbe785-0f47-4fb1-b640-819bd3a187f1 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lazy-loading 'fault' on Instance uuid 8e4e2075-5a0f-4e15-892d-e4b5eb5b8807 {{(pid=118513) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 26 15:01:07.354095 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-37cbe785-0f47-4fb1-b640-819bd3a187f1 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96610ea2bcf84875be6d08859dd0c7b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dffd269c3a344d36b77ebb04d0c412e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:01:07.363630 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-37cbe785-0f47-4fb1-b640-819bd3a187f1 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] 10.222.0.81 "GET /compute/v2.1/servers/8e4e2075-5a0f-4e15-892d-e4b5eb5b8807" status: 200 len: 1304 microversion: 2.1 time: 0.232341 May 26 15:01:07.364209 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 338/648] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:01:07 2021] GET /compute/v2.1/servers/8e4e2075-5a0f-4e15-892d-e4b5eb5b8807 => generated 1304 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:01:07.372551 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-f115bb5b-276c-43d6-88c1-113770789eb8 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565618950dd54005a4a040f4dd0cbb33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c65d1e254f424ebfea8360aa697c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:01:07.381772 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-f115bb5b-276c-43d6-88c1-113770789eb8 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /compute/v2.1/servers/29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de" status: 200 len: 1261 microversion: 2.1 time: 0.231103 May 26 15:01:07.382352 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 311/649] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:01:07 2021] GET /compute/v2.1/servers/29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de => generated 1261 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:01:07.509132 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-793343ce-d0de-4262-96ce-56a5be25c6ed tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1287726356", "imageRef": "dcacad62-e278-4869-aa20-e5df07dd03db", "flavorRef": "452", "networks": [{"uuid": "9f5bc9eb-1964-454a-a177-4bdcfc4e0298"}]}} {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:01:07.575942 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.network.neutron [None req-793343ce-d0de-4262-96ce-56a5be25c6ed tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] validate_networks() for [('9f5bc9eb-1964-454a-a177-4bdcfc4e0298', None, None, None)] {{(pid=118513) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} May 26 15:01:07.808183 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-168f9373-1d45-49c1-a609-f9f6b093d276 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:07.808797 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-168f9373-1d45-49c1-a609-f9f6b093d276 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 598b0e3f-8cf1-451a-80a8-ed7e5dd36984] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:01:07.818386 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-168f9373-1d45-49c1-a609-f9f6b093d276 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:07.818871 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-168f9373-1d45-49c1-a609-f9f6b093d276 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:07.819675 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-168f9373-1d45-49c1-a609-f9f6b093d276 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:07.820126 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-168f9373-1d45-49c1-a609-f9f6b093d276 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:08.046375 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-168f9373-1d45-49c1-a609-f9f6b093d276 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:01:08.056814 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-168f9373-1d45-49c1-a609-f9f6b093d276 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:01:08.058481 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-168f9373-1d45-49c1-a609-f9f6b093d276 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:01:08.059629 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-168f9373-1d45-49c1-a609-f9f6b093d276 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984" status: 200 len: 1807 microversion: 2.20 time: 0.255352 May 26 15:01:08.060264 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 312/650] 10.222.0.81 () {60 vars in 1277 bytes} [Wed May 26 15:01:07 2021] GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984 => generated 1807 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 15:01:08.064762 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-5fa4ce4e-a31a-416b-9c10-261541dcbc32 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:08.065266 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-5fa4ce4e-a31a-416b-9c10-261541dcbc32 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] [instance: acc03344-b5df-4277-82e4-c9b3228969ca] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:01:08.071552 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.virt.hardware [None req-793343ce-d0de-4262-96ce-56a5be25c6ed tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Flavor limits 0:0:0 {{(pid=118513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} May 26 15:01:08.072008 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.virt.hardware [None req-793343ce-d0de-4262-96ce-56a5be25c6ed tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Image limits 0:0:0 {{(pid=118513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} May 26 15:01:08.072583 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.virt.hardware [None req-793343ce-d0de-4262-96ce-56a5be25c6ed tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Flavor pref 0:0:0 {{(pid=118513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} May 26 15:01:08.072775 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-5fa4ce4e-a31a-416b-9c10-261541dcbc32 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:08.073003 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.virt.hardware [None req-793343ce-d0de-4262-96ce-56a5be25c6ed tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Image pref 0:0:0 {{(pid=118513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} May 26 15:01:08.073241 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-5fa4ce4e-a31a-416b-9c10-261541dcbc32 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:08.073426 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.virt.hardware [None req-793343ce-d0de-4262-96ce-56a5be25c6ed tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} May 26 15:01:08.074116 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-5fa4ce4e-a31a-416b-9c10-261541dcbc32 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:08.074562 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-5fa4ce4e-a31a-416b-9c10-261541dcbc32 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:08.082253 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-793343ce-d0de-4262-96ce-56a5be25c6ed tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:08.082710 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-793343ce-d0de-4262-96ce-56a5be25c6ed tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:08.083527 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-793343ce-d0de-4262-96ce-56a5be25c6ed tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:08.083977 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-793343ce-d0de-4262-96ce-56a5be25c6ed tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:08.101993 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.quota [None req-793343ce-d0de-4262-96ce-56a5be25c6ed tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Getting quotas for project 5b729993a1944061bb0a708877c95a5c. Resources: {'instances', 'ram', 'cores'} {{(pid=118513) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 26 15:01:08.105995 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.quota [None req-793343ce-d0de-4262-96ce-56a5be25c6ed tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Getting quotas for user 0b8604f942d44fec96828cc0b1ae5960 and project 5b729993a1944061bb0a708877c95a5c. Resources: {'instances', 'ram', 'cores'} {{(pid=118513) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 26 15:01:08.117703 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-793343ce-d0de-4262-96ce-56a5be25c6ed tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Going to run 1 instances... {{(pid=118513) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 26 15:01:08.120030 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-793343ce-d0de-4262-96ce-56a5be25c6ed tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] [instance: 2d11ba61-751c-43a5-9a56-5638a6afe727] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dcacad62-e278-4869-aa20-e5df07dd03db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118513) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} May 26 15:01:08.135193 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-5fa4ce4e-a31a-416b-9c10-261541dcbc32 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] [instance: acc03344-b5df-4277-82e4-c9b3228969ca] Going to try to terminate instance {{(pid=118514) delete /opt/stack/nova/nova/compute/api.py:2539}} May 26 15:01:08.202342 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 15:01:08.202925 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: Wed May 26 15:01:08 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.81) !!! May 26 15:01:08.294580 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-793343ce-d0de-4262-96ce-56a5be25c6ed tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.789221 May 26 15:01:08.295159 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 339/651] 10.222.0.81 () {60 vars in 1147 bytes} [Wed May 26 15:01:07 2021] POST /compute/v2.1/servers => generated 380 bytes in 791 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 15:01:08.304476 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-7c9c4e77-cd8c-40e0-9d48-5f6bb0b5e141 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:08.305088 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-7c9c4e77-cd8c-40e0-9d48-5f6bb0b5e141 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] [instance: 2d11ba61-751c-43a5-9a56-5638a6afe727] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:01:08.379574 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-7c9c4e77-cd8c-40e0-9d48-5f6bb0b5e141 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8604f942d44fec96828cc0b1ae5960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b729993a1944061bb0a708877c95a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:01:08.386974 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-7c9c4e77-cd8c-40e0-9d48-5f6bb0b5e141 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] 10.222.0.81 "GET /compute/v2.1/servers/2d11ba61-751c-43a5-9a56-5638a6afe727" status: 200 len: 1219 microversion: 2.1 time: 0.085909 May 26 15:01:08.387527 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 340/652] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:01:08 2021] GET /compute/v2.1/servers/2d11ba61-751c-43a5-9a56-5638a6afe727 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:01:08.400852 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-e5af26aa-cc90-48e6-aa3d-cb0355d53af5 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:08.401516 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-e5af26aa-cc90-48e6-aa3d-cb0355d53af5 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] [instance: 8e4e2075-5a0f-4e15-892d-e4b5eb5b8807] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:01:08.417036 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-e5af26aa-cc90-48e6-aa3d-cb0355d53af5 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:08.417397 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-e5af26aa-cc90-48e6-aa3d-cb0355d53af5 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:08.418217 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-e5af26aa-cc90-48e6-aa3d-cb0355d53af5 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:08.418660 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-e5af26aa-cc90-48e6-aa3d-cb0355d53af5 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:08.470771 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.wsgi [None req-e5af26aa-cc90-48e6-aa3d-cb0355d53af5 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] HTTP exception thrown: Instance 8e4e2075-5a0f-4e15-892d-e4b5eb5b8807 could not be found. May 26 15:01:08.471394 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-e5af26aa-cc90-48e6-aa3d-cb0355d53af5 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] Returning 404 to user: Instance 8e4e2075-5a0f-4e15-892d-e4b5eb5b8807 could not be found. {{(pid=118513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 26 15:01:08.472225 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-e5af26aa-cc90-48e6-aa3d-cb0355d53af5 tempest-VolumesActionsTest-1416941652 tempest-VolumesActionsTest-1416941652-project] 10.222.0.81 "GET /compute/v2.1/servers/8e4e2075-5a0f-4e15-892d-e4b5eb5b8807" status: 404 len: 111 microversion: 2.1 time: 0.075211 May 26 15:01:08.472782 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 341/653] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:01:08 2021] GET /compute/v2.1/servers/8e4e2075-5a0f-4e15-892d-e4b5eb5b8807 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 15:01:08.477017 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-e8aeeda3-d158-40fe-8cf4-df8c683e5ea8 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:08.477653 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-e8aeeda3-d158-40fe-8cf4-df8c683e5ea8 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] [instance: 29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:01:08.485441 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-e8aeeda3-d158-40fe-8cf4-df8c683e5ea8 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:08.485936 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-e8aeeda3-d158-40fe-8cf4-df8c683e5ea8 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:08.486818 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-e8aeeda3-d158-40fe-8cf4-df8c683e5ea8 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:08.487121 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-e8aeeda3-d158-40fe-8cf4-df8c683e5ea8 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:08.499740 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-5fa4ce4e-a31a-416b-9c10-261541dcbc32 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "DELETE /compute/v2.1/servers/acc03344-b5df-4277-82e4-c9b3228969ca" status: 204 len: 0 microversion: 2.1 time: 0.438163 May 26 15:01:08.500339 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 313/654] 10.222.0.81 () {58 vars in 1239 bytes} [Wed May 26 15:01:08 2021] DELETE /compute/v2.1/servers/acc03344-b5df-4277-82e4-c9b3228969ca => generated 0 bytes in 440 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 15:01:08.512537 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-a0f470a7-5bf9-4915-b219-3ff28b1629c8 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:08.513311 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-a0f470a7-5bf9-4915-b219-3ff28b1629c8 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] [instance: acc03344-b5df-4277-82e4-c9b3228969ca] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:01:08.522338 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-a0f470a7-5bf9-4915-b219-3ff28b1629c8 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:08.522793 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-a0f470a7-5bf9-4915-b219-3ff28b1629c8 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:08.523697 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-a0f470a7-5bf9-4915-b219-3ff28b1629c8 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:08.524208 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-a0f470a7-5bf9-4915-b219-3ff28b1629c8 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:08.697237 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-e8aeeda3-d158-40fe-8cf4-df8c683e5ea8 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565618950dd54005a4a040f4dd0cbb33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c65d1e254f424ebfea8360aa697c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:01:08.707354 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-e8aeeda3-d158-40fe-8cf4-df8c683e5ea8 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /compute/v2.1/servers/29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de" status: 200 len: 1261 microversion: 2.1 time: 0.233462 May 26 15:01:08.708534 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 342/655] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:01:08 2021] GET /compute/v2.1/servers/29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de => generated 1261 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:01:08.822068 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-a0f470a7-5bf9-4915-b219-3ff28b1629c8 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b167942c895345b186a3eda5c82175b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad2ab2705ca479ab4aaafe7c80de162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:01:08.830531 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-a0f470a7-5bf9-4915-b219-3ff28b1629c8 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /compute/v2.1/servers/acc03344-b5df-4277-82e4-c9b3228969ca" status: 200 len: 1508 microversion: 2.1 time: 0.321991 May 26 15:01:08.831513 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 314/656] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:01:08 2021] GET /compute/v2.1/servers/acc03344-b5df-4277-82e4-c9b3228969ca => generated 1508 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:01:08.990096 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [req-15e40674-6b32-455c-85d2-1bacd8c58b28 req-7a04e394-d82a-4460-8b90-785fbeb6a924 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "598b0e3f-8cf1-451a-80a8-ed7e5dd36984", "name": "network-vif-plugged", "status": "completed", "tag": "e948d481-711f-45b8-8deb-08b7658709e7"}]} {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:01:08.995363 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 15:01:08.995363 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: warnings.warn(msg) May 26 15:01:09.001226 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [req-15e40674-6b32-455c-85d2-1bacd8c58b28 req-7a04e394-d82a-4460-8b90-785fbeb6a924 service nova] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:09.001720 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [req-15e40674-6b32-455c-85d2-1bacd8c58b28 req-7a04e394-d82a-4460-8b90-785fbeb6a924 service nova] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:09.020934 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.compute.server_external_events [req-15e40674-6b32-455c-85d2-1bacd8c58b28 req-7a04e394-d82a-4460-8b90-785fbeb6a924 service nova] Creating event network-vif-plugged:e948d481-711f-45b8-8deb-08b7658709e7 for instance 598b0e3f-8cf1-451a-80a8-ed7e5dd36984 on hv-cinder-78414 May 26 15:01:09.023214 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [req-15e40674-6b32-455c-85d2-1bacd8c58b28 req-7a04e394-d82a-4460-8b90-785fbeb6a924 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037899 May 26 15:01:09.023800 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 343/657] 10.222.0.81 () {64 vars in 1318 bytes} [Wed May 26 15:01:08 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:01:09.078032 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-84667d03-9980-4773-9626-fcf89d75cc32 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:09.078908 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-84667d03-9980-4773-9626-fcf89d75cc32 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 598b0e3f-8cf1-451a-80a8-ed7e5dd36984] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:01:09.087916 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-84667d03-9980-4773-9626-fcf89d75cc32 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:09.088622 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-84667d03-9980-4773-9626-fcf89d75cc32 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:09.089800 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-84667d03-9980-4773-9626-fcf89d75cc32 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:09.090239 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-84667d03-9980-4773-9626-fcf89d75cc32 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:09.316107 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-84667d03-9980-4773-9626-fcf89d75cc32 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:01:09.336664 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-84667d03-9980-4773-9626-fcf89d75cc32 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:01:09.338604 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-84667d03-9980-4773-9626-fcf89d75cc32 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:01:09.339904 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-84667d03-9980-4773-9626-fcf89d75cc32 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984" status: 200 len: 1807 microversion: 2.20 time: 0.265510 May 26 15:01:09.340478 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 315/658] 10.222.0.81 () {60 vars in 1277 bytes} [Wed May 26 15:01:09 2021] GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984 => generated 1807 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:01:09.404134 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-790adf85-86a0-4b62-9787-4d96e05e0662 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:09.404840 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-790adf85-86a0-4b62-9787-4d96e05e0662 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] [instance: 2d11ba61-751c-43a5-9a56-5638a6afe727] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:01:09.412966 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-790adf85-86a0-4b62-9787-4d96e05e0662 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:09.413435 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-790adf85-86a0-4b62-9787-4d96e05e0662 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:09.414256 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-790adf85-86a0-4b62-9787-4d96e05e0662 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:09.414734 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-790adf85-86a0-4b62-9787-4d96e05e0662 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:09.534289 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-790adf85-86a0-4b62-9787-4d96e05e0662 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8604f942d44fec96828cc0b1ae5960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b729993a1944061bb0a708877c95a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:01:09.544356 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-790adf85-86a0-4b62-9787-4d96e05e0662 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] 10.222.0.81 "GET /compute/v2.1/servers/2d11ba61-751c-43a5-9a56-5638a6afe727" status: 200 len: 1223 microversion: 2.1 time: 0.144584 May 26 15:01:09.544934 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 344/659] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:01:09 2021] GET /compute/v2.1/servers/2d11ba61-751c-43a5-9a56-5638a6afe727 => generated 1223 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:01:09.724483 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-ebd4f6b6-c852-4aa9-8c86-f1ea631c32d6 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:09.725090 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-ebd4f6b6-c852-4aa9-8c86-f1ea631c32d6 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] [instance: 29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:01:09.739359 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-ebd4f6b6-c852-4aa9-8c86-f1ea631c32d6 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:09.739359 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-ebd4f6b6-c852-4aa9-8c86-f1ea631c32d6 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:09.739359 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-ebd4f6b6-c852-4aa9-8c86-f1ea631c32d6 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:09.739359 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-ebd4f6b6-c852-4aa9-8c86-f1ea631c32d6 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:09.847812 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-b68fcd82-a137-42b4-8d1c-be58d63c56b7 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:09.848452 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-b68fcd82-a137-42b4-8d1c-be58d63c56b7 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] [instance: acc03344-b5df-4277-82e4-c9b3228969ca] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:01:09.855769 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-b68fcd82-a137-42b4-8d1c-be58d63c56b7 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:09.856225 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-b68fcd82-a137-42b4-8d1c-be58d63c56b7 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:09.857002 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-b68fcd82-a137-42b4-8d1c-be58d63c56b7 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:09.857444 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-b68fcd82-a137-42b4-8d1c-be58d63c56b7 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:10.036344 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-ebd4f6b6-c852-4aa9-8c86-f1ea631c32d6 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565618950dd54005a4a040f4dd0cbb33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c65d1e254f424ebfea8360aa697c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:01:10.045346 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-ebd4f6b6-c852-4aa9-8c86-f1ea631c32d6 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /compute/v2.1/servers/29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de" status: 200 len: 1261 microversion: 2.1 time: 0.324484 May 26 15:01:10.046548 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 316/660] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:01:09 2021] GET /compute/v2.1/servers/29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de => generated 1261 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:01:10.086420 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-b68fcd82-a137-42b4-8d1c-be58d63c56b7 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b167942c895345b186a3eda5c82175b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad2ab2705ca479ab4aaafe7c80de162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:01:10.095536 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-b68fcd82-a137-42b4-8d1c-be58d63c56b7 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /compute/v2.1/servers/acc03344-b5df-4277-82e4-c9b3228969ca" status: 200 len: 1508 microversion: 2.1 time: 0.251921 May 26 15:01:10.096221 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 345/661] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:01:09 2021] GET /compute/v2.1/servers/acc03344-b5df-4277-82e4-c9b3228969ca => generated 1508 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:01:10.358326 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-983392ad-8b0f-4189-a526-e4a45ba4be71 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:10.359051 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-983392ad-8b0f-4189-a526-e4a45ba4be71 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 598b0e3f-8cf1-451a-80a8-ed7e5dd36984] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:01:10.367649 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-983392ad-8b0f-4189-a526-e4a45ba4be71 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:10.368106 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-983392ad-8b0f-4189-a526-e4a45ba4be71 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:10.368955 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-983392ad-8b0f-4189-a526-e4a45ba4be71 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:10.369396 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-983392ad-8b0f-4189-a526-e4a45ba4be71 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:10.496099 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-65a3d016-ec1f-47ff-941a-8c7a15d14c35 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:10.496722 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-65a3d016-ec1f-47ff-941a-8c7a15d14c35 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] [instance: 4266a63b-9328-4c00-81d2-3583ceb5d080] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:01:10.504635 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-65a3d016-ec1f-47ff-941a-8c7a15d14c35 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:10.505132 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-65a3d016-ec1f-47ff-941a-8c7a15d14c35 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:10.506016 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-65a3d016-ec1f-47ff-941a-8c7a15d14c35 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:10.506884 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-65a3d016-ec1f-47ff-941a-8c7a15d14c35 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:10.614475 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-983392ad-8b0f-4189-a526-e4a45ba4be71 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:01:10.624100 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-983392ad-8b0f-4189-a526-e4a45ba4be71 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:01:10.625673 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-983392ad-8b0f-4189-a526-e4a45ba4be71 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:01:10.626831 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-983392ad-8b0f-4189-a526-e4a45ba4be71 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984" status: 200 len: 1807 microversion: 2.20 time: 0.272305 May 26 15:01:10.627719 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 317/662] 10.222.0.81 () {60 vars in 1277 bytes} [Wed May 26 15:01:10 2021] GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984 => generated 1807 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:01:10.632499 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-81fe7aa4-df4b-40c3-8264-f4246910da74 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:10.633260 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-81fe7aa4-df4b-40c3-8264-f4246910da74 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] [instance: 2d11ba61-751c-43a5-9a56-5638a6afe727] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:01:10.640709 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-81fe7aa4-df4b-40c3-8264-f4246910da74 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:10.641731 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-81fe7aa4-df4b-40c3-8264-f4246910da74 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:10.642518 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-81fe7aa4-df4b-40c3-8264-f4246910da74 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:10.642963 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-81fe7aa4-df4b-40c3-8264-f4246910da74 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:10.675064 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.objects.instance [None req-65a3d016-ec1f-47ff-941a-8c7a15d14c35 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lazy-loading 'services' on Instance uuid 4266a63b-9328-4c00-81d2-3583ceb5d080 {{(pid=118513) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 26 15:01:10.771608 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-81fe7aa4-df4b-40c3-8264-f4246910da74 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8604f942d44fec96828cc0b1ae5960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b729993a1944061bb0a708877c95a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:01:10.781056 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-81fe7aa4-df4b-40c3-8264-f4246910da74 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] 10.222.0.81 "GET /compute/v2.1/servers/2d11ba61-751c-43a5-9a56-5638a6afe727" status: 200 len: 1279 microversion: 2.1 time: 0.152051 May 26 15:01:10.781761 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 318/663] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:01:10 2021] GET /compute/v2.1/servers/2d11ba61-751c-43a5-9a56-5638a6afe727 => generated 1279 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:01:11.012326 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-65a3d016-ec1f-47ff-941a-8c7a15d14c35 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "DELETE /compute/v2.1/servers/4266a63b-9328-4c00-81d2-3583ceb5d080/os-volume_attachments/8f312ac5-0f9f-4ddd-8fdc-5b18a3bc4a2d" status: 202 len: 0 microversion: 2.1 time: 0.520297 May 26 15:01:11.012831 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 346/664] 10.222.0.81 () {58 vars in 1416 bytes} [Wed May 26 15:01:10 2021] DELETE /compute/v2.1/servers/4266a63b-9328-4c00-81d2-3583ceb5d080/os-volume_attachments/8f312ac5-0f9f-4ddd-8fdc-5b18a3bc4a2d => generated 0 bytes in 522 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 26 15:01:11.061000 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-2fc18792-5c24-4566-9c4a-021da6fbbc31 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:11.061653 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-2fc18792-5c24-4566-9c4a-021da6fbbc31 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] [instance: 29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:01:11.069207 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-2fc18792-5c24-4566-9c4a-021da6fbbc31 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:11.069699 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-2fc18792-5c24-4566-9c4a-021da6fbbc31 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:11.070485 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-2fc18792-5c24-4566-9c4a-021da6fbbc31 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:11.070930 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-2fc18792-5c24-4566-9c4a-021da6fbbc31 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:11.115881 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-b8bf5e30-a095-42d5-b37c-446deaf5ddd3 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:11.116754 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-b8bf5e30-a095-42d5-b37c-446deaf5ddd3 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] [instance: acc03344-b5df-4277-82e4-c9b3228969ca] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:01:11.124208 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-b8bf5e30-a095-42d5-b37c-446deaf5ddd3 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:11.124701 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-b8bf5e30-a095-42d5-b37c-446deaf5ddd3 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:11.125897 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-b8bf5e30-a095-42d5-b37c-446deaf5ddd3 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:11.126069 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-b8bf5e30-a095-42d5-b37c-446deaf5ddd3 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:11.268672 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-2fc18792-5c24-4566-9c4a-021da6fbbc31 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565618950dd54005a4a040f4dd0cbb33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c65d1e254f424ebfea8360aa697c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:01:11.277054 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-2fc18792-5c24-4566-9c4a-021da6fbbc31 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /compute/v2.1/servers/29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de" status: 200 len: 1261 microversion: 2.1 time: 0.219725 May 26 15:01:11.277634 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 319/665] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:01:11 2021] GET /compute/v2.1/servers/29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de => generated 1261 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:01:11.325129 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-b8bf5e30-a095-42d5-b37c-446deaf5ddd3 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b167942c895345b186a3eda5c82175b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad2ab2705ca479ab4aaafe7c80de162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:01:11.333494 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-b8bf5e30-a095-42d5-b37c-446deaf5ddd3 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /compute/v2.1/servers/acc03344-b5df-4277-82e4-c9b3228969ca" status: 200 len: 1508 microversion: 2.1 time: 0.222095 May 26 15:01:11.334086 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 347/666] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:01:11 2021] GET /compute/v2.1/servers/acc03344-b5df-4277-82e4-c9b3228969ca => generated 1508 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:01:11.645173 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-af8d2bd2-58f0-4be8-858f-f7f6d0e21287 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:11.645818 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-af8d2bd2-58f0-4be8-858f-f7f6d0e21287 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 598b0e3f-8cf1-451a-80a8-ed7e5dd36984] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:01:11.653389 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-af8d2bd2-58f0-4be8-858f-f7f6d0e21287 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:11.653947 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-af8d2bd2-58f0-4be8-858f-f7f6d0e21287 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:11.654721 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-af8d2bd2-58f0-4be8-858f-f7f6d0e21287 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:11.655173 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-af8d2bd2-58f0-4be8-858f-f7f6d0e21287 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:11.806344 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-5d6d0301-0bd0-463b-a5c0-c9ab632495f7 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:11.806868 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-5d6d0301-0bd0-463b-a5c0-c9ab632495f7 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] [instance: 2d11ba61-751c-43a5-9a56-5638a6afe727] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:01:11.814836 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-5d6d0301-0bd0-463b-a5c0-c9ab632495f7 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:11.815300 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-5d6d0301-0bd0-463b-a5c0-c9ab632495f7 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:11.816186 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-5d6d0301-0bd0-463b-a5c0-c9ab632495f7 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:11.816635 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-5d6d0301-0bd0-463b-a5c0-c9ab632495f7 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:11.858411 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-af8d2bd2-58f0-4be8-858f-f7f6d0e21287 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:01:11.868100 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-af8d2bd2-58f0-4be8-858f-f7f6d0e21287 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:01:11.869642 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-af8d2bd2-58f0-4be8-858f-f7f6d0e21287 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:01:11.870782 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-af8d2bd2-58f0-4be8-858f-f7f6d0e21287 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984" status: 200 len: 1807 microversion: 2.20 time: 0.229884 May 26 15:01:11.871354 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 320/667] 10.222.0.81 () {60 vars in 1277 bytes} [Wed May 26 15:01:11 2021] GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984 => generated 1807 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:01:11.930438 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-5d6d0301-0bd0-463b-a5c0-c9ab632495f7 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8604f942d44fec96828cc0b1ae5960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b729993a1944061bb0a708877c95a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:01:11.939458 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-5d6d0301-0bd0-463b-a5c0-c9ab632495f7 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] 10.222.0.81 "GET /compute/v2.1/servers/2d11ba61-751c-43a5-9a56-5638a6afe727" status: 200 len: 1289 microversion: 2.1 time: 0.136771 May 26 15:01:11.940027 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 348/668] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:01:11 2021] GET /compute/v2.1/servers/2d11ba61-751c-43a5-9a56-5638a6afe727 => generated 1289 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:01:12.293100 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-afcc3e4c-dcac-4c0e-8794-f6f6287d1f74 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:12.293849 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-afcc3e4c-dcac-4c0e-8794-f6f6287d1f74 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] [instance: 29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:01:12.302003 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-afcc3e4c-dcac-4c0e-8794-f6f6287d1f74 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:12.302456 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-afcc3e4c-dcac-4c0e-8794-f6f6287d1f74 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:12.303226 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-afcc3e4c-dcac-4c0e-8794-f6f6287d1f74 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:12.303657 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-afcc3e4c-dcac-4c0e-8794-f6f6287d1f74 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:12.350688 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-826577f4-54e8-46f1-9b7c-ac99f938d1a9 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:12.351227 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-826577f4-54e8-46f1-9b7c-ac99f938d1a9 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] [instance: acc03344-b5df-4277-82e4-c9b3228969ca] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:01:12.358362 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-826577f4-54e8-46f1-9b7c-ac99f938d1a9 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:12.358823 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-826577f4-54e8-46f1-9b7c-ac99f938d1a9 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:12.359607 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-826577f4-54e8-46f1-9b7c-ac99f938d1a9 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:12.360603 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-826577f4-54e8-46f1-9b7c-ac99f938d1a9 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:12.503156 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-afcc3e4c-dcac-4c0e-8794-f6f6287d1f74 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565618950dd54005a4a040f4dd0cbb33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c65d1e254f424ebfea8360aa697c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:01:12.512009 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-afcc3e4c-dcac-4c0e-8794-f6f6287d1f74 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /compute/v2.1/servers/29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de" status: 200 len: 1261 microversion: 2.1 time: 0.222610 May 26 15:01:12.512840 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 321/669] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:01:12 2021] GET /compute/v2.1/servers/29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de => generated 1261 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:01:12.562307 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-826577f4-54e8-46f1-9b7c-ac99f938d1a9 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b167942c895345b186a3eda5c82175b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad2ab2705ca479ab4aaafe7c80de162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:01:12.571298 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-826577f4-54e8-46f1-9b7c-ac99f938d1a9 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /compute/v2.1/servers/acc03344-b5df-4277-82e4-c9b3228969ca" status: 200 len: 1508 microversion: 2.1 time: 0.224344 May 26 15:01:12.571872 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 349/670] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:01:12 2021] GET /compute/v2.1/servers/acc03344-b5df-4277-82e4-c9b3228969ca => generated 1508 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:01:12.889258 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-a0ab00cd-d6df-4688-a14f-bf15f0dfc4c5 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:12.889898 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-a0ab00cd-d6df-4688-a14f-bf15f0dfc4c5 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 598b0e3f-8cf1-451a-80a8-ed7e5dd36984] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:01:12.897321 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-a0ab00cd-d6df-4688-a14f-bf15f0dfc4c5 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:12.897822 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-a0ab00cd-d6df-4688-a14f-bf15f0dfc4c5 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:12.898624 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-a0ab00cd-d6df-4688-a14f-bf15f0dfc4c5 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:12.899068 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-a0ab00cd-d6df-4688-a14f-bf15f0dfc4c5 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:12.956090 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-08b1ad8e-2e2a-4f88-ad94-69406298288a tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:12.956710 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-08b1ad8e-2e2a-4f88-ad94-69406298288a tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] [instance: 2d11ba61-751c-43a5-9a56-5638a6afe727] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:01:12.964073 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-08b1ad8e-2e2a-4f88-ad94-69406298288a tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:12.964524 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-08b1ad8e-2e2a-4f88-ad94-69406298288a tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:12.965315 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-08b1ad8e-2e2a-4f88-ad94-69406298288a tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:12.965803 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-08b1ad8e-2e2a-4f88-ad94-69406298288a tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:13.078142 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-08b1ad8e-2e2a-4f88-ad94-69406298288a tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8604f942d44fec96828cc0b1ae5960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b729993a1944061bb0a708877c95a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:01:13.086735 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-08b1ad8e-2e2a-4f88-ad94-69406298288a tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] 10.222.0.81 "GET /compute/v2.1/servers/2d11ba61-751c-43a5-9a56-5638a6afe727" status: 200 len: 1289 microversion: 2.1 time: 0.134358 May 26 15:01:13.087316 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 350/671] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:01:12 2021] GET /compute/v2.1/servers/2d11ba61-751c-43a5-9a56-5638a6afe727 => generated 1289 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:01:13.106189 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-a0ab00cd-d6df-4688-a14f-bf15f0dfc4c5 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:01:13.116114 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-a0ab00cd-d6df-4688-a14f-bf15f0dfc4c5 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:01:13.117673 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-a0ab00cd-d6df-4688-a14f-bf15f0dfc4c5 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:01:13.118806 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-a0ab00cd-d6df-4688-a14f-bf15f0dfc4c5 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984" status: 200 len: 1807 microversion: 2.20 time: 0.233339 May 26 15:01:13.119363 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 322/672] 10.222.0.81 () {60 vars in 1277 bytes} [Wed May 26 15:01:12 2021] GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984 => generated 1807 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:01:13.530345 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-19a827a6-7819-4cc2-aa47-4ae6bd983a20 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:13.530956 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-19a827a6-7819-4cc2-aa47-4ae6bd983a20 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] [instance: 29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:01:13.539034 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-19a827a6-7819-4cc2-aa47-4ae6bd983a20 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:13.539495 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-19a827a6-7819-4cc2-aa47-4ae6bd983a20 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:13.540432 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-19a827a6-7819-4cc2-aa47-4ae6bd983a20 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:13.540694 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-19a827a6-7819-4cc2-aa47-4ae6bd983a20 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:13.587885 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-43c35ee8-05ec-4e0c-9936-9356753e2a8d tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:13.588505 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-43c35ee8-05ec-4e0c-9936-9356753e2a8d tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] [instance: acc03344-b5df-4277-82e4-c9b3228969ca] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:01:13.596468 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-43c35ee8-05ec-4e0c-9936-9356753e2a8d tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:13.596915 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-43c35ee8-05ec-4e0c-9936-9356753e2a8d tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:13.597749 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-43c35ee8-05ec-4e0c-9936-9356753e2a8d tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:13.598196 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-43c35ee8-05ec-4e0c-9936-9356753e2a8d tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:13.740298 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-19a827a6-7819-4cc2-aa47-4ae6bd983a20 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565618950dd54005a4a040f4dd0cbb33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c65d1e254f424ebfea8360aa697c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:01:13.748477 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-19a827a6-7819-4cc2-aa47-4ae6bd983a20 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /compute/v2.1/servers/29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de" status: 200 len: 1261 microversion: 2.1 time: 0.222023 May 26 15:01:13.749051 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 351/673] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:01:13 2021] GET /compute/v2.1/servers/29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de => generated 1261 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:01:13.803880 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-43c35ee8-05ec-4e0c-9936-9356753e2a8d tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b167942c895345b186a3eda5c82175b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad2ab2705ca479ab4aaafe7c80de162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:01:13.812070 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-43c35ee8-05ec-4e0c-9936-9356753e2a8d tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /compute/v2.1/servers/acc03344-b5df-4277-82e4-c9b3228969ca" status: 200 len: 1508 microversion: 2.1 time: 0.227860 May 26 15:01:13.812645 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 323/674] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:01:13 2021] GET /compute/v2.1/servers/acc03344-b5df-4277-82e4-c9b3228969ca => generated 1508 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:01:14.105840 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-bb3b5178-8714-4398-942b-f976eeee5a5a tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:14.106290 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-bb3b5178-8714-4398-942b-f976eeee5a5a tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] [instance: 2d11ba61-751c-43a5-9a56-5638a6afe727] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:01:14.114044 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-bb3b5178-8714-4398-942b-f976eeee5a5a tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:14.114505 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-bb3b5178-8714-4398-942b-f976eeee5a5a tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:14.120457 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-bb3b5178-8714-4398-942b-f976eeee5a5a tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:14.120457 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-bb3b5178-8714-4398-942b-f976eeee5a5a tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:14.137908 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-e316221b-1193-4e6f-900d-ad3093e87335 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:14.138604 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-e316221b-1193-4e6f-900d-ad3093e87335 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 598b0e3f-8cf1-451a-80a8-ed7e5dd36984] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:01:14.151669 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-e316221b-1193-4e6f-900d-ad3093e87335 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:14.152122 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-e316221b-1193-4e6f-900d-ad3093e87335 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:14.152921 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-e316221b-1193-4e6f-900d-ad3093e87335 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:14.153363 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-e316221b-1193-4e6f-900d-ad3093e87335 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:14.263961 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-bb3b5178-8714-4398-942b-f976eeee5a5a tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8604f942d44fec96828cc0b1ae5960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b729993a1944061bb0a708877c95a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:01:14.274306 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-bb3b5178-8714-4398-942b-f976eeee5a5a tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] 10.222.0.81 "GET /compute/v2.1/servers/2d11ba61-751c-43a5-9a56-5638a6afe727" status: 200 len: 1289 microversion: 2.1 time: 0.174326 May 26 15:01:14.283049 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 352/675] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:01:14 2021] GET /compute/v2.1/servers/2d11ba61-751c-43a5-9a56-5638a6afe727 => generated 1289 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:01:14.765620 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-0266994b-9872-44c7-8c18-bc63ee59c6a0 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:14.766528 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-0266994b-9872-44c7-8c18-bc63ee59c6a0 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] [instance: 29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:01:14.778701 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-0266994b-9872-44c7-8c18-bc63ee59c6a0 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:14.780473 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-0266994b-9872-44c7-8c18-bc63ee59c6a0 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:14.784269 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-e316221b-1193-4e6f-900d-ad3093e87335 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:01:14.784751 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-0266994b-9872-44c7-8c18-bc63ee59c6a0 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:14.785507 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-0266994b-9872-44c7-8c18-bc63ee59c6a0 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:14.793693 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-e316221b-1193-4e6f-900d-ad3093e87335 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:01:14.795217 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-e316221b-1193-4e6f-900d-ad3093e87335 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:01:14.796360 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-e316221b-1193-4e6f-900d-ad3093e87335 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984" status: 200 len: 1807 microversion: 2.20 time: 0.662187 May 26 15:01:14.797116 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 324/676] 10.222.0.81 () {60 vars in 1277 bytes} [Wed May 26 15:01:14 2021] GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984 => generated 1807 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 15:01:14.830027 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-465ae525-4516-45f3-a3a3-d627034ca447 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:14.830234 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-465ae525-4516-45f3-a3a3-d627034ca447 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] [instance: acc03344-b5df-4277-82e4-c9b3228969ca] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:01:14.841925 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-465ae525-4516-45f3-a3a3-d627034ca447 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:14.842392 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-465ae525-4516-45f3-a3a3-d627034ca447 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:14.843187 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-465ae525-4516-45f3-a3a3-d627034ca447 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:14.843636 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-465ae525-4516-45f3-a3a3-d627034ca447 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:15.066618 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-0266994b-9872-44c7-8c18-bc63ee59c6a0 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565618950dd54005a4a040f4dd0cbb33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c65d1e254f424ebfea8360aa697c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:01:15.075139 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-0266994b-9872-44c7-8c18-bc63ee59c6a0 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /compute/v2.1/servers/29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de" status: 200 len: 1261 microversion: 2.1 time: 0.313221 May 26 15:01:15.075732 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 353/677] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:01:14 2021] GET /compute/v2.1/servers/29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de => generated 1261 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:01:15.228840 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-465ae525-4516-45f3-a3a3-d627034ca447 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b167942c895345b186a3eda5c82175b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad2ab2705ca479ab4aaafe7c80de162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:01:15.239954 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-465ae525-4516-45f3-a3a3-d627034ca447 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /compute/v2.1/servers/acc03344-b5df-4277-82e4-c9b3228969ca" status: 200 len: 1508 microversion: 2.1 time: 0.414558 May 26 15:01:15.240567 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 325/678] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:01:14 2021] GET /compute/v2.1/servers/acc03344-b5df-4277-82e4-c9b3228969ca => generated 1508 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:01:15.291894 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-61d2d46c-6b56-4796-a174-8a4cd8a29d6a tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:15.296448 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-61d2d46c-6b56-4796-a174-8a4cd8a29d6a tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] [instance: 2d11ba61-751c-43a5-9a56-5638a6afe727] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:01:15.303531 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-61d2d46c-6b56-4796-a174-8a4cd8a29d6a tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:15.304005 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-61d2d46c-6b56-4796-a174-8a4cd8a29d6a tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:15.304800 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-61d2d46c-6b56-4796-a174-8a4cd8a29d6a tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:15.305245 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-61d2d46c-6b56-4796-a174-8a4cd8a29d6a tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:15.575930 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-61d2d46c-6b56-4796-a174-8a4cd8a29d6a tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8604f942d44fec96828cc0b1ae5960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b729993a1944061bb0a708877c95a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:01:15.587200 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-61d2d46c-6b56-4796-a174-8a4cd8a29d6a tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] 10.222.0.81 "GET /compute/v2.1/servers/2d11ba61-751c-43a5-9a56-5638a6afe727" status: 200 len: 1319 microversion: 2.1 time: 0.299462 May 26 15:01:15.588203 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 354/679] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:01:15 2021] GET /compute/v2.1/servers/2d11ba61-751c-43a5-9a56-5638a6afe727 => generated 1319 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:01:15.821903 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-e13d2fbe-aac1-4542-b193-c8d36b941887 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:15.823998 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-e13d2fbe-aac1-4542-b193-c8d36b941887 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 598b0e3f-8cf1-451a-80a8-ed7e5dd36984] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:01:15.866888 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-e13d2fbe-aac1-4542-b193-c8d36b941887 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:15.866888 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-e13d2fbe-aac1-4542-b193-c8d36b941887 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:15.866888 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-e13d2fbe-aac1-4542-b193-c8d36b941887 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:15.867296 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-e13d2fbe-aac1-4542-b193-c8d36b941887 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:16.106602 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-8f75315e-b82f-4bcb-80ee-25e912a954cd tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:16.112741 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-8f75315e-b82f-4bcb-80ee-25e912a954cd tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] [instance: 29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:01:16.137983 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-8f75315e-b82f-4bcb-80ee-25e912a954cd tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:16.141311 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-8f75315e-b82f-4bcb-80ee-25e912a954cd tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:16.142961 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-8f75315e-b82f-4bcb-80ee-25e912a954cd tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:16.143397 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-8f75315e-b82f-4bcb-80ee-25e912a954cd tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:16.471993 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-e13d2fbe-aac1-4542-b193-c8d36b941887 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:01:16.495225 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-e13d2fbe-aac1-4542-b193-c8d36b941887 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:01:16.497124 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-e13d2fbe-aac1-4542-b193-c8d36b941887 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:01:16.498537 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-e13d2fbe-aac1-4542-b193-c8d36b941887 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984" status: 200 len: 1807 microversion: 2.20 time: 0.686279 May 26 15:01:16.499682 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 326/680] 10.222.0.81 () {60 vars in 1277 bytes} [Wed May 26 15:01:15 2021] GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984 => generated 1807 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 15:01:16.505160 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-d5b23ad9-866d-4c46-8996-2ac2b64334b8 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:16.506068 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-d5b23ad9-866d-4c46-8996-2ac2b64334b8 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] [instance: acc03344-b5df-4277-82e4-c9b3228969ca] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:01:16.515926 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-d5b23ad9-866d-4c46-8996-2ac2b64334b8 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:16.518187 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-d5b23ad9-866d-4c46-8996-2ac2b64334b8 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:16.519577 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-d5b23ad9-866d-4c46-8996-2ac2b64334b8 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:16.520431 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-d5b23ad9-866d-4c46-8996-2ac2b64334b8 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:17.100183 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-d5b23ad9-866d-4c46-8996-2ac2b64334b8 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b167942c895345b186a3eda5c82175b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad2ab2705ca479ab4aaafe7c80de162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:01:17.120002 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-d5b23ad9-866d-4c46-8996-2ac2b64334b8 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /compute/v2.1/servers/acc03344-b5df-4277-82e4-c9b3228969ca" status: 200 len: 1508 microversion: 2.1 time: 0.614793 May 26 15:01:17.130006 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 327/681] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:01:16 2021] GET /compute/v2.1/servers/acc03344-b5df-4277-82e4-c9b3228969ca => generated 1508 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:01:17.135994 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-034e190e-4b77-4b7c-b3dd-327e15a24d25 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:17.144088 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-034e190e-4b77-4b7c-b3dd-327e15a24d25 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] [instance: 2d11ba61-751c-43a5-9a56-5638a6afe727] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:01:17.157027 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-034e190e-4b77-4b7c-b3dd-327e15a24d25 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:17.157584 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-034e190e-4b77-4b7c-b3dd-327e15a24d25 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:17.158419 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-034e190e-4b77-4b7c-b3dd-327e15a24d25 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:17.158863 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-034e190e-4b77-4b7c-b3dd-327e15a24d25 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:17.245261 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-8f75315e-b82f-4bcb-80ee-25e912a954cd tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565618950dd54005a4a040f4dd0cbb33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c65d1e254f424ebfea8360aa697c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:01:17.257853 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-8f75315e-b82f-4bcb-80ee-25e912a954cd tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /compute/v2.1/servers/29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de" status: 200 len: 1261 microversion: 2.1 time: 1.163585 May 26 15:01:17.260437 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 355/682] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:01:16 2021] GET /compute/v2.1/servers/29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de => generated 1261 bytes in 1167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:01:17.309585 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [req-7fa79342-0e8c-4770-b7e7-d04268c88008 req-e4e31372-f7c0-4db5-ab57-a69f35e4d5be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d11ba61-751c-43a5-9a56-5638a6afe727", "tag": "5ae9ad7a-f33d-4cca-8a87-1bb5070abea8"}]} {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:01:17.311418 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 15:01:17.311418 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: warnings.warn(msg) May 26 15:01:17.328334 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [req-7fa79342-0e8c-4770-b7e7-d04268c88008 req-e4e31372-f7c0-4db5-ab57-a69f35e4d5be service nova] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:17.329962 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [req-7fa79342-0e8c-4770-b7e7-d04268c88008 req-e4e31372-f7c0-4db5-ab57-a69f35e4d5be service nova] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:17.376337 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.compute.server_external_events [req-7fa79342-0e8c-4770-b7e7-d04268c88008 req-e4e31372-f7c0-4db5-ab57-a69f35e4d5be service nova] Creating event network-changed:5ae9ad7a-f33d-4cca-8a87-1bb5070abea8 for instance 2d11ba61-751c-43a5-9a56-5638a6afe727 on hv-cinder-78414 May 26 15:01:17.387845 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [req-7fa79342-0e8c-4770-b7e7-d04268c88008 req-e4e31372-f7c0-4db5-ab57-a69f35e4d5be service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082077 May 26 15:01:17.388738 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 356/683] 10.222.0.81 () {64 vars in 1318 bytes} [Wed May 26 15:01:17 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:01:17.406008 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [req-8f04e0b2-6786-4182-914a-bad7b2f2b92e req-3a564dcd-053e-46c9-a268-ef12470f3586 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acc03344-b5df-4277-82e4-c9b3228969ca", "name": "network-vif-deleted", "tag": "0cdf2872-b922-4d87-8260-bb3c5b2a449b"}]} {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:01:17.412438 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 15:01:17.412438 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: warnings.warn(msg) May 26 15:01:17.429744 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [req-8f04e0b2-6786-4182-914a-bad7b2f2b92e req-3a564dcd-053e-46c9-a268-ef12470f3586 service nova] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:17.430794 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [req-8f04e0b2-6786-4182-914a-bad7b2f2b92e req-3a564dcd-053e-46c9-a268-ef12470f3586 service nova] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:17.452154 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.compute.server_external_events [req-8f04e0b2-6786-4182-914a-bad7b2f2b92e req-3a564dcd-053e-46c9-a268-ef12470f3586 service nova] Creating event network-vif-deleted:0cdf2872-b922-4d87-8260-bb3c5b2a449b for instance acc03344-b5df-4277-82e4-c9b3228969ca on hv-cinder-78414 May 26 15:01:17.458699 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [req-8f04e0b2-6786-4182-914a-bad7b2f2b92e req-3a564dcd-053e-46c9-a268-ef12470f3586 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068537 May 26 15:01:17.460081 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 357/684] 10.222.0.81 () {64 vars in 1318 bytes} [Wed May 26 15:01:17 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:01:17.519115 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-807cefb6-558a-4864-bb44-fce988781810 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:17.520603 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-807cefb6-558a-4864-bb44-fce988781810 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 598b0e3f-8cf1-451a-80a8-ed7e5dd36984] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:01:17.541168 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-807cefb6-558a-4864-bb44-fce988781810 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:17.542318 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-807cefb6-558a-4864-bb44-fce988781810 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:17.543874 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-807cefb6-558a-4864-bb44-fce988781810 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:17.544821 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-807cefb6-558a-4864-bb44-fce988781810 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:17.862192 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-807cefb6-558a-4864-bb44-fce988781810 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:01:17.879613 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-807cefb6-558a-4864-bb44-fce988781810 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:01:17.881230 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-807cefb6-558a-4864-bb44-fce988781810 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:01:17.882449 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-807cefb6-558a-4864-bb44-fce988781810 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984" status: 200 len: 1794 microversion: 2.20 time: 0.368565 May 26 15:01:17.893725 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 358/685] 10.222.0.81 () {60 vars in 1277 bytes} [Wed May 26 15:01:17 2021] GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984 => generated 1794 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 15:01:17.913215 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [req-fc2f27ee-c5cf-46ba-933d-90c8164f8be5 req-6ee107e9-ab4a-4b16-ab0d-2b9bc4bcbce6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de", "name": "network-vif-plugged", "status": "completed", "tag": "24388d3c-fd02-41f5-996a-da7452902c2b"}]} {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:01:17.915206 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 15:01:17.915206 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: warnings.warn(msg) May 26 15:01:17.924707 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [req-fc2f27ee-c5cf-46ba-933d-90c8164f8be5 req-6ee107e9-ab4a-4b16-ab0d-2b9bc4bcbce6 service nova] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:17.925581 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [req-fc2f27ee-c5cf-46ba-933d-90c8164f8be5 req-6ee107e9-ab4a-4b16-ab0d-2b9bc4bcbce6 service nova] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:17.943162 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.compute.server_external_events [req-fc2f27ee-c5cf-46ba-933d-90c8164f8be5 req-6ee107e9-ab4a-4b16-ab0d-2b9bc4bcbce6 service nova] Creating event network-vif-plugged:24388d3c-fd02-41f5-996a-da7452902c2b for instance 29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de on hv-cinder-78414 May 26 15:01:17.948578 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [req-fc2f27ee-c5cf-46ba-933d-90c8164f8be5 req-6ee107e9-ab4a-4b16-ab0d-2b9bc4bcbce6 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053436 May 26 15:01:17.952079 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 359/686] 10.222.0.81 () {64 vars in 1318 bytes} [Wed May 26 15:01:17 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:01:18.100930 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-034e190e-4b77-4b7c-b3dd-327e15a24d25 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8604f942d44fec96828cc0b1ae5960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b729993a1944061bb0a708877c95a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:01:18.111188 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-034e190e-4b77-4b7c-b3dd-327e15a24d25 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] 10.222.0.81 "GET /compute/v2.1/servers/2d11ba61-751c-43a5-9a56-5638a6afe727" status: 200 len: 1319 microversion: 2.1 time: 0.987157 May 26 15:01:18.112352 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 328/687] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:01:17 2021] GET /compute/v2.1/servers/2d11ba61-751c-43a5-9a56-5638a6afe727 => generated 1319 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:01:18.143370 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-e8167170-fa96-486e-a7cb-17e76c9a48b8 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:18.144156 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-e8167170-fa96-486e-a7cb-17e76c9a48b8 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] [instance: acc03344-b5df-4277-82e4-c9b3228969ca] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:01:18.152337 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-e8167170-fa96-486e-a7cb-17e76c9a48b8 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:18.152832 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-e8167170-fa96-486e-a7cb-17e76c9a48b8 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:18.153657 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-e8167170-fa96-486e-a7cb-17e76c9a48b8 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:18.154240 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-e8167170-fa96-486e-a7cb-17e76c9a48b8 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:18.276898 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-dc16837a-c61b-4718-8492-2381783ea872 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:18.278189 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-dc16837a-c61b-4718-8492-2381783ea872 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] [instance: 29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:01:18.296034 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-dc16837a-c61b-4718-8492-2381783ea872 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:18.298193 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-dc16837a-c61b-4718-8492-2381783ea872 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:18.301181 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-dc16837a-c61b-4718-8492-2381783ea872 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:18.302106 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-dc16837a-c61b-4718-8492-2381783ea872 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:18.309861 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-e8167170-fa96-486e-a7cb-17e76c9a48b8 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:18.310613 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-e8167170-fa96-486e-a7cb-17e76c9a48b8 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:18.310892 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.objects.instance [None req-e8167170-fa96-486e-a7cb-17e76c9a48b8 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lazy-loading 'fault' on Instance uuid acc03344-b5df-4277-82e4-c9b3228969ca {{(pid=118513) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 26 15:01:18.604297 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-e8167170-fa96-486e-a7cb-17e76c9a48b8 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b167942c895345b186a3eda5c82175b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad2ab2705ca479ab4aaafe7c80de162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:01:18.616689 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-e8167170-fa96-486e-a7cb-17e76c9a48b8 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /compute/v2.1/servers/acc03344-b5df-4277-82e4-c9b3228969ca" status: 200 len: 1312 microversion: 2.1 time: 0.478576 May 26 15:01:18.617281 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 360/688] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:01:18 2021] GET /compute/v2.1/servers/acc03344-b5df-4277-82e4-c9b3228969ca => generated 1312 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:01:18.624333 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-f235d424-ca22-4b02-8bb2-762bd06ffe9c tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:18.624826 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-f235d424-ca22-4b02-8bb2-762bd06ffe9c tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] [instance: 4266a63b-9328-4c00-81d2-3583ceb5d080] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:01:18.638472 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-f235d424-ca22-4b02-8bb2-762bd06ffe9c tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:18.638932 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-f235d424-ca22-4b02-8bb2-762bd06ffe9c tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:18.639976 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-f235d424-ca22-4b02-8bb2-762bd06ffe9c tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:18.640585 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-f235d424-ca22-4b02-8bb2-762bd06ffe9c tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:18.707180 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-f235d424-ca22-4b02-8bb2-762bd06ffe9c tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] [instance: 4266a63b-9328-4c00-81d2-3583ceb5d080] Going to try to terminate instance {{(pid=118513) delete /opt/stack/nova/nova/compute/api.py:2539}} May 26 15:01:18.823184 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-dc16837a-c61b-4718-8492-2381783ea872 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565618950dd54005a4a040f4dd0cbb33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c65d1e254f424ebfea8360aa697c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:01:18.847380 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-dc16837a-c61b-4718-8492-2381783ea872 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /compute/v2.1/servers/29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de" status: 200 len: 1261 microversion: 2.1 time: 0.570923 May 26 15:01:18.852986 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 329/689] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:01:18 2021] GET /compute/v2.1/servers/29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de => generated 1261 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:01:19.134510 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-3c71a497-7a9b-44bf-97d4-8513986ac452 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:19.136120 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-3c71a497-7a9b-44bf-97d4-8513986ac452 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] [instance: 2d11ba61-751c-43a5-9a56-5638a6afe727] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:01:19.145723 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-3c71a497-7a9b-44bf-97d4-8513986ac452 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:19.148660 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-3c71a497-7a9b-44bf-97d4-8513986ac452 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:19.148660 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-3c71a497-7a9b-44bf-97d4-8513986ac452 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:19.148660 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-3c71a497-7a9b-44bf-97d4-8513986ac452 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:19.196354 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-f235d424-ca22-4b02-8bb2-762bd06ffe9c tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "DELETE /compute/v2.1/servers/4266a63b-9328-4c00-81d2-3583ceb5d080" status: 204 len: 0 microversion: 2.1 time: 0.577716 May 26 15:01:19.197300 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 361/690] 10.222.0.81 () {58 vars in 1239 bytes} [Wed May 26 15:01:18 2021] DELETE /compute/v2.1/servers/4266a63b-9328-4c00-81d2-3583ceb5d080 => generated 0 bytes in 579 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 15:01:19.205859 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-61a7a3c9-3861-493c-9d66-e78b589a9df0 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:19.206775 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-61a7a3c9-3861-493c-9d66-e78b589a9df0 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] [instance: 4266a63b-9328-4c00-81d2-3583ceb5d080] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:01:19.215030 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-61a7a3c9-3861-493c-9d66-e78b589a9df0 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:19.215578 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-61a7a3c9-3861-493c-9d66-e78b589a9df0 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:19.216451 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-61a7a3c9-3861-493c-9d66-e78b589a9df0 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:19.216969 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-61a7a3c9-3861-493c-9d66-e78b589a9df0 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:19.409595 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-3c71a497-7a9b-44bf-97d4-8513986ac452 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8604f942d44fec96828cc0b1ae5960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b729993a1944061bb0a708877c95a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:01:19.421030 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-3c71a497-7a9b-44bf-97d4-8513986ac452 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] 10.222.0.81 "GET /compute/v2.1/servers/2d11ba61-751c-43a5-9a56-5638a6afe727" status: 200 len: 1319 microversion: 2.1 time: 0.291236 May 26 15:01:19.430731 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 330/691] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:01:19 2021] GET /compute/v2.1/servers/2d11ba61-751c-43a5-9a56-5638a6afe727 => generated 1319 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:01:19.444992 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-61a7a3c9-3861-493c-9d66-e78b589a9df0 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be4bd5c0f2a400da491bae101b48832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515325707f64d58a28f26451b2c74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:01:19.454158 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-61a7a3c9-3861-493c-9d66-e78b589a9df0 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /compute/v2.1/servers/4266a63b-9328-4c00-81d2-3583ceb5d080" status: 200 len: 1514 microversion: 2.1 time: 0.252251 May 26 15:01:19.464562 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 362/692] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:01:19 2021] GET /compute/v2.1/servers/4266a63b-9328-4c00-81d2-3583ceb5d080 => generated 1514 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:01:19.634635 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-96f362bd-e36b-4583-abe0-efac1e11dc8b tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:19.635415 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-96f362bd-e36b-4583-abe0-efac1e11dc8b tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] [instance: acc03344-b5df-4277-82e4-c9b3228969ca] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:01:19.643174 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-96f362bd-e36b-4583-abe0-efac1e11dc8b tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:19.643637 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-96f362bd-e36b-4583-abe0-efac1e11dc8b tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:19.644421 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-96f362bd-e36b-4583-abe0-efac1e11dc8b tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:19.644874 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-96f362bd-e36b-4583-abe0-efac1e11dc8b tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:19.703998 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.wsgi [None req-96f362bd-e36b-4583-abe0-efac1e11dc8b tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] HTTP exception thrown: Instance acc03344-b5df-4277-82e4-c9b3228969ca could not be found. May 26 15:01:19.704638 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-96f362bd-e36b-4583-abe0-efac1e11dc8b tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Returning 404 to user: Instance acc03344-b5df-4277-82e4-c9b3228969ca could not be found. {{(pid=118514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 26 15:01:19.705502 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-96f362bd-e36b-4583-abe0-efac1e11dc8b tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /compute/v2.1/servers/acc03344-b5df-4277-82e4-c9b3228969ca" status: 404 len: 111 microversion: 2.1 time: 0.074629 May 26 15:01:19.706079 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 331/693] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:01:19 2021] GET /compute/v2.1/servers/acc03344-b5df-4277-82e4-c9b3228969ca => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 26 15:01:19.715182 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-0ca199dc-c8e1-4797-9871-363525cf6aa9 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:19.715674 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-0ca199dc-c8e1-4797-9871-363525cf6aa9 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] [instance: aa145a33-41b1-4e39-9642-132aca11fcfe] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:01:19.724486 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-0ca199dc-c8e1-4797-9871-363525cf6aa9 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:19.728649 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-0ca199dc-c8e1-4797-9871-363525cf6aa9 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:19.728649 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-0ca199dc-c8e1-4797-9871-363525cf6aa9 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:19.728649 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-0ca199dc-c8e1-4797-9871-363525cf6aa9 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:19.788815 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-0ca199dc-c8e1-4797-9871-363525cf6aa9 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] [instance: aa145a33-41b1-4e39-9642-132aca11fcfe] Going to try to terminate instance {{(pid=118513) delete /opt/stack/nova/nova/compute/api.py:2539}} May 26 15:01:19.865278 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-37e7f67c-4f65-4233-9477-519a8bb1485b tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:19.866053 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-37e7f67c-4f65-4233-9477-519a8bb1485b tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] [instance: 29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:01:19.882672 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-37e7f67c-4f65-4233-9477-519a8bb1485b tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:19.883726 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-37e7f67c-4f65-4233-9477-519a8bb1485b tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:19.887376 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-37e7f67c-4f65-4233-9477-519a8bb1485b tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:19.888026 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-37e7f67c-4f65-4233-9477-519a8bb1485b tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:20.113015 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-0ca199dc-c8e1-4797-9871-363525cf6aa9 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "DELETE /compute/v2.1/servers/aa145a33-41b1-4e39-9642-132aca11fcfe" status: 204 len: 0 microversion: 2.1 time: 0.402250 May 26 15:01:20.114164 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 363/694] 10.222.0.81 () {58 vars in 1239 bytes} [Wed May 26 15:01:19 2021] DELETE /compute/v2.1/servers/aa145a33-41b1-4e39-9642-132aca11fcfe => generated 0 bytes in 404 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 26 15:01:20.128344 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-bd554f86-5988-45af-985e-0fab5dbfa319 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:20.129211 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-bd554f86-5988-45af-985e-0fab5dbfa319 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] [instance: aa145a33-41b1-4e39-9642-132aca11fcfe] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:01:20.138472 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-bd554f86-5988-45af-985e-0fab5dbfa319 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:20.138931 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-bd554f86-5988-45af-985e-0fab5dbfa319 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:20.139778 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-bd554f86-5988-45af-985e-0fab5dbfa319 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:20.140224 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-bd554f86-5988-45af-985e-0fab5dbfa319 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:20.181112 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-37e7f67c-4f65-4233-9477-519a8bb1485b tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565618950dd54005a4a040f4dd0cbb33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c65d1e254f424ebfea8360aa697c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:01:20.193566 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-37e7f67c-4f65-4233-9477-519a8bb1485b tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /compute/v2.1/servers/29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de" status: 200 len: 1261 microversion: 2.1 time: 0.331831 May 26 15:01:20.194452 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 332/695] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:01:19 2021] GET /compute/v2.1/servers/29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de => generated 1261 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:01:20.380706 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-bd554f86-5988-45af-985e-0fab5dbfa319 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b167942c895345b186a3eda5c82175b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad2ab2705ca479ab4aaafe7c80de162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:01:20.389670 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-bd554f86-5988-45af-985e-0fab5dbfa319 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /compute/v2.1/servers/aa145a33-41b1-4e39-9642-132aca11fcfe" status: 200 len: 1521 microversion: 2.1 time: 0.271105 May 26 15:01:20.390336 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 364/696] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:01:20 2021] GET /compute/v2.1/servers/aa145a33-41b1-4e39-9642-132aca11fcfe => generated 1521 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:01:20.438099 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-c495f372-672b-41e6-ae67-70fa616e5c80 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:20.439240 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-c495f372-672b-41e6-ae67-70fa616e5c80 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] [instance: 2d11ba61-751c-43a5-9a56-5638a6afe727] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:01:20.447568 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-c495f372-672b-41e6-ae67-70fa616e5c80 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:20.448263 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-c495f372-672b-41e6-ae67-70fa616e5c80 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:20.449278 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-c495f372-672b-41e6-ae67-70fa616e5c80 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:20.449760 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-c495f372-672b-41e6-ae67-70fa616e5c80 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:20.473439 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-8f438c4d-3704-4735-ac95-0be15f045d4c tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:20.480168 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-8f438c4d-3704-4735-ac95-0be15f045d4c tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] [instance: 4266a63b-9328-4c00-81d2-3583ceb5d080] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:01:20.486572 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-8f438c4d-3704-4735-ac95-0be15f045d4c tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:20.487081 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-8f438c4d-3704-4735-ac95-0be15f045d4c tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:20.487877 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-8f438c4d-3704-4735-ac95-0be15f045d4c tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:20.488535 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-8f438c4d-3704-4735-ac95-0be15f045d4c tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:20.763370 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-8f438c4d-3704-4735-ac95-0be15f045d4c tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be4bd5c0f2a400da491bae101b48832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515325707f64d58a28f26451b2c74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:01:20.775782 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-8f438c4d-3704-4735-ac95-0be15f045d4c tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /compute/v2.1/servers/4266a63b-9328-4c00-81d2-3583ceb5d080" status: 200 len: 1514 microversion: 2.1 time: 0.307223 May 26 15:01:20.778400 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 365/697] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:01:20 2021] GET /compute/v2.1/servers/4266a63b-9328-4c00-81d2-3583ceb5d080 => generated 1514 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:01:20.806762 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-c495f372-672b-41e6-ae67-70fa616e5c80 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8604f942d44fec96828cc0b1ae5960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b729993a1944061bb0a708877c95a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:01:20.816592 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-c495f372-672b-41e6-ae67-70fa616e5c80 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] 10.222.0.81 "GET /compute/v2.1/servers/2d11ba61-751c-43a5-9a56-5638a6afe727" status: 200 len: 1319 microversion: 2.1 time: 0.382161 May 26 15:01:20.817152 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 333/698] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:01:20 2021] GET /compute/v2.1/servers/2d11ba61-751c-43a5-9a56-5638a6afe727 => generated 1319 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:01:21.212088 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-8fd38fc6-60e4-466b-844d-242d775bbcb3 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:21.212896 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-8fd38fc6-60e4-466b-844d-242d775bbcb3 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] [instance: 29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:01:21.222947 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-8fd38fc6-60e4-466b-844d-242d775bbcb3 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:21.223715 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-8fd38fc6-60e4-466b-844d-242d775bbcb3 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:21.224734 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-8fd38fc6-60e4-466b-844d-242d775bbcb3 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:21.225326 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-8fd38fc6-60e4-466b-844d-242d775bbcb3 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:21.410606 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-b874eb7d-b366-4e3f-a09a-bd39708d0d61 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:21.412716 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-b874eb7d-b366-4e3f-a09a-bd39708d0d61 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] [instance: aa145a33-41b1-4e39-9642-132aca11fcfe] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:01:21.423555 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-b874eb7d-b366-4e3f-a09a-bd39708d0d61 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:21.424402 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-b874eb7d-b366-4e3f-a09a-bd39708d0d61 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:21.426130 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-b874eb7d-b366-4e3f-a09a-bd39708d0d61 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:21.426672 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-b874eb7d-b366-4e3f-a09a-bd39708d0d61 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:21.465327 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-8fd38fc6-60e4-466b-844d-242d775bbcb3 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565618950dd54005a4a040f4dd0cbb33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c65d1e254f424ebfea8360aa697c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:01:21.477842 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-8fd38fc6-60e4-466b-844d-242d775bbcb3 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /compute/v2.1/servers/29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de" status: 200 len: 1445 microversion: 2.1 time: 0.268871 May 26 15:01:21.478902 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 366/699] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:01:21 2021] GET /compute/v2.1/servers/29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de => generated 1445 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:01:21.494661 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-9d9b5e02-d713-4d98-9d9b-03c55c648e81 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:21.495555 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-9d9b5e02-d713-4d98-9d9b-03c55c648e81 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] [instance: 29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:01:21.505111 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-9d9b5e02-d713-4d98-9d9b-03c55c648e81 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:21.506182 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-9d9b5e02-d713-4d98-9d9b-03c55c648e81 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:21.507151 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-9d9b5e02-d713-4d98-9d9b-03c55c648e81 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:21.507599 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-9d9b5e02-d713-4d98-9d9b-03c55c648e81 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:21.667981 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-b874eb7d-b366-4e3f-a09a-bd39708d0d61 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b167942c895345b186a3eda5c82175b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad2ab2705ca479ab4aaafe7c80de162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:01:21.677090 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-b874eb7d-b366-4e3f-a09a-bd39708d0d61 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /compute/v2.1/servers/aa145a33-41b1-4e39-9642-132aca11fcfe" status: 200 len: 1521 microversion: 2.1 time: 0.271714 May 26 15:01:21.681501 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 334/700] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:01:21 2021] GET /compute/v2.1/servers/aa145a33-41b1-4e39-9642-132aca11fcfe => generated 1521 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:01:21.770913 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-9d9b5e02-d713-4d98-9d9b-03c55c648e81 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565618950dd54005a4a040f4dd0cbb33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c65d1e254f424ebfea8360aa697c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:01:21.779866 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-9d9b5e02-d713-4d98-9d9b-03c55c648e81 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /compute/v2.1/servers/29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de" status: 200 len: 1445 microversion: 2.1 time: 0.289042 May 26 15:01:21.785327 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 367/701] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:01:21 2021] GET /compute/v2.1/servers/29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de => generated 1445 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:01:21.803309 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-0bea3e9a-1ba3-4818-b6a0-1031d7b3a501 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:21.803940 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-0bea3e9a-1ba3-4818-b6a0-1031d7b3a501 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] [instance: 4266a63b-9328-4c00-81d2-3583ceb5d080] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:01:21.814624 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-0bea3e9a-1ba3-4818-b6a0-1031d7b3a501 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:21.815537 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-0bea3e9a-1ba3-4818-b6a0-1031d7b3a501 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:21.816738 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-0bea3e9a-1ba3-4818-b6a0-1031d7b3a501 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:21.817228 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-0bea3e9a-1ba3-4818-b6a0-1031d7b3a501 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:21.833688 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-35dee6b5-490b-43b5-a921-6d208f4e0a34 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:21.834579 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-35dee6b5-490b-43b5-a921-6d208f4e0a34 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] [instance: 2d11ba61-751c-43a5-9a56-5638a6afe727] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:01:21.847654 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-35dee6b5-490b-43b5-a921-6d208f4e0a34 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:21.851330 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-35dee6b5-490b-43b5-a921-6d208f4e0a34 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:21.852564 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-35dee6b5-490b-43b5-a921-6d208f4e0a34 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:21.853045 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-35dee6b5-490b-43b5-a921-6d208f4e0a34 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:22.157987 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-35dee6b5-490b-43b5-a921-6d208f4e0a34 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8604f942d44fec96828cc0b1ae5960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b729993a1944061bb0a708877c95a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:01:22.189998 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-35dee6b5-490b-43b5-a921-6d208f4e0a34 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] 10.222.0.81 "GET /compute/v2.1/servers/2d11ba61-751c-43a5-9a56-5638a6afe727" status: 200 len: 1319 microversion: 2.1 time: 0.359846 May 26 15:01:22.195630 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 368/702] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:01:21 2021] GET /compute/v2.1/servers/2d11ba61-751c-43a5-9a56-5638a6afe727 => generated 1319 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:01:22.313878 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-0bea3e9a-1ba3-4818-b6a0-1031d7b3a501 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be4bd5c0f2a400da491bae101b48832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515325707f64d58a28f26451b2c74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:01:22.326928 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-0bea3e9a-1ba3-4818-b6a0-1031d7b3a501 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /compute/v2.1/servers/4266a63b-9328-4c00-81d2-3583ceb5d080" status: 200 len: 1514 microversion: 2.1 time: 0.532720 May 26 15:01:22.340762 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 335/703] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:01:21 2021] GET /compute/v2.1/servers/4266a63b-9328-4c00-81d2-3583ceb5d080 => generated 1514 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:01:22.696140 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-05da3aa5-e939-42fd-8cc2-cb9f9c7289c7 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:22.697382 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-05da3aa5-e939-42fd-8cc2-cb9f9c7289c7 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] [instance: aa145a33-41b1-4e39-9642-132aca11fcfe] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:01:22.708022 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-05da3aa5-e939-42fd-8cc2-cb9f9c7289c7 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:22.711349 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-05da3aa5-e939-42fd-8cc2-cb9f9c7289c7 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:22.712905 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-05da3aa5-e939-42fd-8cc2-cb9f9c7289c7 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:22.714092 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-05da3aa5-e939-42fd-8cc2-cb9f9c7289c7 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:23.033362 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-05da3aa5-e939-42fd-8cc2-cb9f9c7289c7 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b167942c895345b186a3eda5c82175b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad2ab2705ca479ab4aaafe7c80de162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:01:23.046530 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-05da3aa5-e939-42fd-8cc2-cb9f9c7289c7 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /compute/v2.1/servers/aa145a33-41b1-4e39-9642-132aca11fcfe" status: 200 len: 1521 microversion: 2.1 time: 0.354429 May 26 15:01:23.047119 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 369/704] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:01:22 2021] GET /compute/v2.1/servers/aa145a33-41b1-4e39-9642-132aca11fcfe => generated 1521 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:01:23.212101 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-21411c0a-5137-4078-b360-5eeb0259b371 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:23.212814 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-21411c0a-5137-4078-b360-5eeb0259b371 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] [instance: 2d11ba61-751c-43a5-9a56-5638a6afe727] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:01:23.221383 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-21411c0a-5137-4078-b360-5eeb0259b371 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:23.222122 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-21411c0a-5137-4078-b360-5eeb0259b371 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:23.224138 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-21411c0a-5137-4078-b360-5eeb0259b371 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:23.229520 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-21411c0a-5137-4078-b360-5eeb0259b371 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:23.280239 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-89842a0b-3f7b-4a1c-a46b-50e7b4df90ca tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:23.280743 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-89842a0b-3f7b-4a1c-a46b-50e7b4df90ca tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: a9d8f9a6-bd66-4caa-8662-4bb94655ae59] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:01:23.296060 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-89842a0b-3f7b-4a1c-a46b-50e7b4df90ca tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:23.296565 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-89842a0b-3f7b-4a1c-a46b-50e7b4df90ca tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:23.297433 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-89842a0b-3f7b-4a1c-a46b-50e7b4df90ca tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:23.298079 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-89842a0b-3f7b-4a1c-a46b-50e7b4df90ca tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:23.993492 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.objects.instance [None req-89842a0b-3f7b-4a1c-a46b-50e7b4df90ca tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lazy-loading 'services' on Instance uuid a9d8f9a6-bd66-4caa-8662-4bb94655ae59 {{(pid=118513) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 26 15:01:24.141295 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-21411c0a-5137-4078-b360-5eeb0259b371 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8604f942d44fec96828cc0b1ae5960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b729993a1944061bb0a708877c95a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:01:24.161242 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-21411c0a-5137-4078-b360-5eeb0259b371 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] 10.222.0.81 "GET /compute/v2.1/servers/2d11ba61-751c-43a5-9a56-5638a6afe727" status: 200 len: 1319 microversion: 2.1 time: 0.954143 May 26 15:01:24.170140 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 336/705] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:01:23 2021] GET /compute/v2.1/servers/2d11ba61-751c-43a5-9a56-5638a6afe727 => generated 1319 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:01:24.170140 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-f1a52fb7-ef05-4833-ac2a-a2dc7f0e6137 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:24.170140 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-f1a52fb7-ef05-4833-ac2a-a2dc7f0e6137 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] [instance: 4266a63b-9328-4c00-81d2-3583ceb5d080] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:01:24.178509 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-f1a52fb7-ef05-4833-ac2a-a2dc7f0e6137 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:24.178970 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-f1a52fb7-ef05-4833-ac2a-a2dc7f0e6137 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:24.180760 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-f1a52fb7-ef05-4833-ac2a-a2dc7f0e6137 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:24.181212 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-f1a52fb7-ef05-4833-ac2a-a2dc7f0e6137 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:24.325460 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-f1a52fb7-ef05-4833-ac2a-a2dc7f0e6137 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:24.326149 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-f1a52fb7-ef05-4833-ac2a-a2dc7f0e6137 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:24.326538 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.objects.instance [None req-f1a52fb7-ef05-4833-ac2a-a2dc7f0e6137 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lazy-loading 'fault' on Instance uuid 4266a63b-9328-4c00-81d2-3583ceb5d080 {{(pid=118514) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 26 15:01:24.376778 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-89842a0b-3f7b-4a1c-a46b-50e7b4df90ca tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "DELETE /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59/os-volume_attachments/705c57c3-af0e-4cd0-a8f5-87e26e7706cf" status: 202 len: 0 microversion: 2.1 time: 1.099514 May 26 15:01:24.378357 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 370/706] 10.222.0.81 () {58 vars in 1416 bytes} [Wed May 26 15:01:23 2021] DELETE /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59/os-volume_attachments/705c57c3-af0e-4cd0-a8f5-87e26e7706cf => generated 0 bytes in 1102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 15:01:24.395076 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [req-f1fea0a9-1800-4b15-bf89-9eba230ac623 req-87e08f27-b16f-4017-bb6e-66f9284439fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4266a63b-9328-4c00-81d2-3583ceb5d080", "name": "network-vif-deleted", "tag": "7b7c8c36-6397-47d6-91bb-4f1db62a6e1a"}]} {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:01:24.402182 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 15:01:24.402182 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: warnings.warn(msg) May 26 15:01:24.416925 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [req-f1fea0a9-1800-4b15-bf89-9eba230ac623 req-87e08f27-b16f-4017-bb6e-66f9284439fd service nova] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:24.417833 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [req-f1fea0a9-1800-4b15-bf89-9eba230ac623 req-87e08f27-b16f-4017-bb6e-66f9284439fd service nova] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:24.449202 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.compute.server_external_events [req-f1fea0a9-1800-4b15-bf89-9eba230ac623 req-87e08f27-b16f-4017-bb6e-66f9284439fd service nova] Creating event network-vif-deleted:7b7c8c36-6397-47d6-91bb-4f1db62a6e1a for instance 4266a63b-9328-4c00-81d2-3583ceb5d080 on hv-cinder-78414 May 26 15:01:24.462914 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [req-f1fea0a9-1800-4b15-bf89-9eba230ac623 req-87e08f27-b16f-4017-bb6e-66f9284439fd service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082538 May 26 15:01:24.465067 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 371/707] 10.222.0.81 () {64 vars in 1318 bytes} [Wed May 26 15:01:24 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:01:24.481559 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-67d626a9-4348-43d1-a5e6-bb2e92d9e1ad tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:24.486082 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-67d626a9-4348-43d1-a5e6-bb2e92d9e1ad tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] [instance: aa145a33-41b1-4e39-9642-132aca11fcfe] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:01:24.499581 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-67d626a9-4348-43d1-a5e6-bb2e92d9e1ad tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:24.500025 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-67d626a9-4348-43d1-a5e6-bb2e92d9e1ad tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:24.501400 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-67d626a9-4348-43d1-a5e6-bb2e92d9e1ad tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:24.501932 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-67d626a9-4348-43d1-a5e6-bb2e92d9e1ad tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:24.567008 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-f1a52fb7-ef05-4833-ac2a-a2dc7f0e6137 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be4bd5c0f2a400da491bae101b48832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515325707f64d58a28f26451b2c74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:01:24.568959 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-f1a52fb7-ef05-4833-ac2a-a2dc7f0e6137 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /compute/v2.1/servers/4266a63b-9328-4c00-81d2-3583ceb5d080" status: 200 len: 1307 microversion: 2.1 time: 0.405585 May 26 15:01:24.569861 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 337/708] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:01:24 2021] GET /compute/v2.1/servers/4266a63b-9328-4c00-81d2-3583ceb5d080 => generated 1307 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:01:24.809746 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-67d626a9-4348-43d1-a5e6-bb2e92d9e1ad tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b167942c895345b186a3eda5c82175b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad2ab2705ca479ab4aaafe7c80de162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:01:24.819642 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-67d626a9-4348-43d1-a5e6-bb2e92d9e1ad tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /compute/v2.1/servers/aa145a33-41b1-4e39-9642-132aca11fcfe" status: 200 len: 1521 microversion: 2.1 time: 0.350421 May 26 15:01:24.829588 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 372/709] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:01:24 2021] GET /compute/v2.1/servers/aa145a33-41b1-4e39-9642-132aca11fcfe => generated 1521 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:01:25.178232 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-965e17a4-a7c7-42ee-b62e-dcb1961e61b5 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:25.179373 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-965e17a4-a7c7-42ee-b62e-dcb1961e61b5 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] [instance: 2d11ba61-751c-43a5-9a56-5638a6afe727] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:01:25.187389 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-965e17a4-a7c7-42ee-b62e-dcb1961e61b5 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:25.188321 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-965e17a4-a7c7-42ee-b62e-dcb1961e61b5 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:25.190084 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-965e17a4-a7c7-42ee-b62e-dcb1961e61b5 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:25.191002 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-965e17a4-a7c7-42ee-b62e-dcb1961e61b5 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:25.439891 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-965e17a4-a7c7-42ee-b62e-dcb1961e61b5 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8604f942d44fec96828cc0b1ae5960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b729993a1944061bb0a708877c95a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:01:25.453454 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-965e17a4-a7c7-42ee-b62e-dcb1961e61b5 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] 10.222.0.81 "GET /compute/v2.1/servers/2d11ba61-751c-43a5-9a56-5638a6afe727" status: 200 len: 1319 microversion: 2.1 time: 0.278745 May 26 15:01:25.466514 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 338/710] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:01:25 2021] GET /compute/v2.1/servers/2d11ba61-751c-43a5-9a56-5638a6afe727 => generated 1319 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:01:25.590968 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-e9af9cd3-f1ab-4f8c-abb4-4b57bf2bfae9 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:25.591581 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-e9af9cd3-f1ab-4f8c-abb4-4b57bf2bfae9 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] [instance: 4266a63b-9328-4c00-81d2-3583ceb5d080] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:01:25.603092 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-e9af9cd3-f1ab-4f8c-abb4-4b57bf2bfae9 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:25.611163 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-e9af9cd3-f1ab-4f8c-abb4-4b57bf2bfae9 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:25.618556 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-e9af9cd3-f1ab-4f8c-abb4-4b57bf2bfae9 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:25.619219 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-e9af9cd3-f1ab-4f8c-abb4-4b57bf2bfae9 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:25.717344 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.wsgi [None req-e9af9cd3-f1ab-4f8c-abb4-4b57bf2bfae9 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] HTTP exception thrown: Instance 4266a63b-9328-4c00-81d2-3583ceb5d080 could not be found. May 26 15:01:25.726994 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-e9af9cd3-f1ab-4f8c-abb4-4b57bf2bfae9 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Returning 404 to user: Instance 4266a63b-9328-4c00-81d2-3583ceb5d080 could not be found. {{(pid=118513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 26 15:01:25.728112 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-e9af9cd3-f1ab-4f8c-abb4-4b57bf2bfae9 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /compute/v2.1/servers/4266a63b-9328-4c00-81d2-3583ceb5d080" status: 404 len: 111 microversion: 2.1 time: 0.141244 May 26 15:01:25.729140 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 373/711] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:01:25 2021] GET /compute/v2.1/servers/4266a63b-9328-4c00-81d2-3583ceb5d080 => generated 111 bytes in 143 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 15:01:25.840842 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-32831f96-7e65-4019-92f0-6b1494e7708e tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:25.841622 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-32831f96-7e65-4019-92f0-6b1494e7708e tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] [instance: aa145a33-41b1-4e39-9642-132aca11fcfe] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:01:25.852805 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-32831f96-7e65-4019-92f0-6b1494e7708e tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:25.861014 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-32831f96-7e65-4019-92f0-6b1494e7708e tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:25.861014 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-32831f96-7e65-4019-92f0-6b1494e7708e tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:25.861014 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-32831f96-7e65-4019-92f0-6b1494e7708e tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:26.125060 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-32831f96-7e65-4019-92f0-6b1494e7708e tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b167942c895345b186a3eda5c82175b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad2ab2705ca479ab4aaafe7c80de162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:01:26.135926 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-32831f96-7e65-4019-92f0-6b1494e7708e tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /compute/v2.1/servers/aa145a33-41b1-4e39-9642-132aca11fcfe" status: 200 len: 1521 microversion: 2.1 time: 0.299128 May 26 15:01:26.137344 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 339/712] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:01:25 2021] GET /compute/v2.1/servers/aa145a33-41b1-4e39-9642-132aca11fcfe => generated 1521 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:01:26.194871 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [req-030da7e6-ad27-4b17-aa50-1194a76a9564 req-f3c66183-a3bd-4f30-afcc-9861b8948b51 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de", "tag": "24388d3c-fd02-41f5-996a-da7452902c2b"}]} {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:01:26.196368 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 15:01:26.196368 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: warnings.warn(msg) May 26 15:01:26.207464 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [req-030da7e6-ad27-4b17-aa50-1194a76a9564 req-f3c66183-a3bd-4f30-afcc-9861b8948b51 service nova] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:26.208083 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [req-030da7e6-ad27-4b17-aa50-1194a76a9564 req-f3c66183-a3bd-4f30-afcc-9861b8948b51 service nova] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:26.229253 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.compute.server_external_events [req-030da7e6-ad27-4b17-aa50-1194a76a9564 req-f3c66183-a3bd-4f30-afcc-9861b8948b51 service nova] Creating event network-changed:24388d3c-fd02-41f5-996a-da7452902c2b for instance 29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de on hv-cinder-78414 May 26 15:01:26.235346 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [req-030da7e6-ad27-4b17-aa50-1194a76a9564 req-f3c66183-a3bd-4f30-afcc-9861b8948b51 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042955 May 26 15:01:26.235346 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 374/713] 10.222.0.81 () {64 vars in 1318 bytes} [Wed May 26 15:01:26 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:01:26.471097 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-a7ee3a9d-29e4-4cb4-8078-7b6126a71926 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:26.472605 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-a7ee3a9d-29e4-4cb4-8078-7b6126a71926 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] [instance: 2d11ba61-751c-43a5-9a56-5638a6afe727] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:01:26.481260 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-a7ee3a9d-29e4-4cb4-8078-7b6126a71926 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:26.482285 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-a7ee3a9d-29e4-4cb4-8078-7b6126a71926 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:26.483318 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-a7ee3a9d-29e4-4cb4-8078-7b6126a71926 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:26.484152 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-a7ee3a9d-29e4-4cb4-8078-7b6126a71926 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:26.923099 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-4c94b9db-8b96-4c6a-973a-c686e10e9917 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:01:26.931785 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-4c94b9db-8b96-4c6a-973a-c686e10e9917 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:26.932488 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-4c94b9db-8b96-4c6a-973a-c686e10e9917 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:26.943976 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-a7ee3a9d-29e4-4cb4-8078-7b6126a71926 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8604f942d44fec96828cc0b1ae5960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b729993a1944061bb0a708877c95a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:01:26.956157 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-a7ee3a9d-29e4-4cb4-8078-7b6126a71926 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] 10.222.0.81 "GET /compute/v2.1/servers/2d11ba61-751c-43a5-9a56-5638a6afe727" status: 200 len: 1319 microversion: 2.1 time: 0.489241 May 26 15:01:26.976472 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 340/714] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:01:26 2021] GET /compute/v2.1/servers/2d11ba61-751c-43a5-9a56-5638a6afe727 => generated 1319 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:01:27.015935 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-4c94b9db-8b96-4c6a-973a-c686e10e9917 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: a9d8f9a6-bd66-4caa-8662-4bb94655ae59] Going to try to stop instance {{(pid=118513) force_stop /opt/stack/nova/nova/compute/api.py:2579}} May 26 15:01:27.154123 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-12a74cdb-f5ef-408f-8a25-fbb63b7ec5b1 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:27.154561 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-12a74cdb-f5ef-408f-8a25-fbb63b7ec5b1 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] [instance: aa145a33-41b1-4e39-9642-132aca11fcfe] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:01:27.165206 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-12a74cdb-f5ef-408f-8a25-fbb63b7ec5b1 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:27.173975 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-12a74cdb-f5ef-408f-8a25-fbb63b7ec5b1 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:27.174948 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-12a74cdb-f5ef-408f-8a25-fbb63b7ec5b1 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:27.175405 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-12a74cdb-f5ef-408f-8a25-fbb63b7ec5b1 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:27.199864 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-4c94b9db-8b96-4c6a-973a-c686e10e9917 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "POST /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59/action" status: 202 len: 0 microversion: 2.1 time: 0.280892 May 26 15:01:27.205418 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 375/715] 10.222.0.81 () {60 vars in 1278 bytes} [Wed May 26 15:01:26 2021] POST /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59/action => generated 0 bytes in 288 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 15:01:27.229050 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-5945081b-cce9-4a67-a594-6b6916811663 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:27.231633 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-5945081b-cce9-4a67-a594-6b6916811663 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: a9d8f9a6-bd66-4caa-8662-4bb94655ae59] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:01:27.252262 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-5945081b-cce9-4a67-a594-6b6916811663 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:27.252778 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-5945081b-cce9-4a67-a594-6b6916811663 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:27.254799 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-5945081b-cce9-4a67-a594-6b6916811663 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:27.255251 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-5945081b-cce9-4a67-a594-6b6916811663 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:27.648896 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-5945081b-cce9-4a67-a594-6b6916811663 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c2fb208b56d4d52b59ac09873f16180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e8cac36a174b2eb5a6e53fdf25b4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:01:27.661077 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-5945081b-cce9-4a67-a594-6b6916811663 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59" status: 200 len: 1677 microversion: 2.1 time: 0.446276 May 26 15:01:27.661702 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 376/716] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:01:27 2021] GET /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59 => generated 1677 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:01:27.675332 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-9866a8f7-4978-4f6f-ba38-910b459f9a0d tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:27.675843 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-9866a8f7-4978-4f6f-ba38-910b459f9a0d tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] [instance: f4f8081b-28f4-4e9f-bf48-471d84e67da8] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:01:27.690892 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-9866a8f7-4978-4f6f-ba38-910b459f9a0d tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:27.691489 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-9866a8f7-4978-4f6f-ba38-910b459f9a0d tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:27.714233 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-9866a8f7-4978-4f6f-ba38-910b459f9a0d tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:27.714711 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-9866a8f7-4978-4f6f-ba38-910b459f9a0d tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:27.794657 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-9866a8f7-4978-4f6f-ba38-910b459f9a0d tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] [instance: f4f8081b-28f4-4e9f-bf48-471d84e67da8] Going to try to terminate instance {{(pid=118513) delete /opt/stack/nova/nova/compute/api.py:2539}} May 26 15:01:27.941248 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-12a74cdb-f5ef-408f-8a25-fbb63b7ec5b1 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b167942c895345b186a3eda5c82175b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad2ab2705ca479ab4aaafe7c80de162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:01:27.958532 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-12a74cdb-f5ef-408f-8a25-fbb63b7ec5b1 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /compute/v2.1/servers/aa145a33-41b1-4e39-9642-132aca11fcfe" status: 200 len: 1521 microversion: 2.1 time: 0.808333 May 26 15:01:27.971339 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 341/717] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:01:27 2021] GET /compute/v2.1/servers/aa145a33-41b1-4e39-9642-132aca11fcfe => generated 1521 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:01:27.992491 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [req-a8ae64ea-ab2c-4a30-86f1-0f141c6abbb1 req-0896674c-cea3-4855-95bd-726323c5539d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d11ba61-751c-43a5-9a56-5638a6afe727", "name": "network-vif-plugged", "status": "completed", "tag": "5ae9ad7a-f33d-4cca-8a87-1bb5070abea8"}]} {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:01:27.994566 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 15:01:27.994566 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: warnings.warn(msg) May 26 15:01:28.010891 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [req-a8ae64ea-ab2c-4a30-86f1-0f141c6abbb1 req-0896674c-cea3-4855-95bd-726323c5539d service nova] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:28.011520 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [req-a8ae64ea-ab2c-4a30-86f1-0f141c6abbb1 req-0896674c-cea3-4855-95bd-726323c5539d service nova] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:28.042033 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.compute.server_external_events [req-a8ae64ea-ab2c-4a30-86f1-0f141c6abbb1 req-0896674c-cea3-4855-95bd-726323c5539d service nova] Creating event network-vif-plugged:5ae9ad7a-f33d-4cca-8a87-1bb5070abea8 for instance 2d11ba61-751c-43a5-9a56-5638a6afe727 on hv-cinder-78414 May 26 15:01:28.050506 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [req-a8ae64ea-ab2c-4a30-86f1-0f141c6abbb1 req-0896674c-cea3-4855-95bd-726323c5539d service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076613 May 26 15:01:28.051506 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 342/718] 10.222.0.81 () {64 vars in 1318 bytes} [Wed May 26 15:01:27 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:01:28.057762 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-192353ec-603f-499a-a4f4-834d79976ee5 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:28.063055 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-192353ec-603f-499a-a4f4-834d79976ee5 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] [instance: 2d11ba61-751c-43a5-9a56-5638a6afe727] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:01:28.075133 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-192353ec-603f-499a-a4f4-834d79976ee5 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:28.076203 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-192353ec-603f-499a-a4f4-834d79976ee5 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:28.077019 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-192353ec-603f-499a-a4f4-834d79976ee5 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:28.077461 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-192353ec-603f-499a-a4f4-834d79976ee5 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:28.270748 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-9866a8f7-4978-4f6f-ba38-910b459f9a0d tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "DELETE /compute/v2.1/servers/f4f8081b-28f4-4e9f-bf48-471d84e67da8" status: 204 len: 0 microversion: 2.1 time: 0.598826 May 26 15:01:28.271930 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 377/719] 10.222.0.81 () {58 vars in 1239 bytes} [Wed May 26 15:01:27 2021] DELETE /compute/v2.1/servers/f4f8081b-28f4-4e9f-bf48-471d84e67da8 => generated 0 bytes in 610 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 15:01:28.280614 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-2fdd2191-1443-47c1-abb1-d5a5288c12ab tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:28.284943 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-2fdd2191-1443-47c1-abb1-d5a5288c12ab tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] [instance: f4f8081b-28f4-4e9f-bf48-471d84e67da8] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:01:28.293295 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-2fdd2191-1443-47c1-abb1-d5a5288c12ab tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:28.296899 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-2fdd2191-1443-47c1-abb1-d5a5288c12ab tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:28.296899 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-2fdd2191-1443-47c1-abb1-d5a5288c12ab tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:28.296899 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-2fdd2191-1443-47c1-abb1-d5a5288c12ab tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:28.630185 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-192353ec-603f-499a-a4f4-834d79976ee5 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8604f942d44fec96828cc0b1ae5960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b729993a1944061bb0a708877c95a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:01:28.640473 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-192353ec-603f-499a-a4f4-834d79976ee5 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] 10.222.0.81 "GET /compute/v2.1/servers/2d11ba61-751c-43a5-9a56-5638a6afe727" status: 200 len: 1319 microversion: 2.1 time: 0.587532 May 26 15:01:28.652950 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 343/720] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:01:28 2021] GET /compute/v2.1/servers/2d11ba61-751c-43a5-9a56-5638a6afe727 => generated 1319 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:01:28.680045 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-2fdd2191-1443-47c1-abb1-d5a5288c12ab tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be4bd5c0f2a400da491bae101b48832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515325707f64d58a28f26451b2c74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:01:28.683125 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-4347f162-e497-43e0-b760-9da5e989ffe6 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:28.684032 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-4347f162-e497-43e0-b760-9da5e989ffe6 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: a9d8f9a6-bd66-4caa-8662-4bb94655ae59] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:01:28.691157 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-2fdd2191-1443-47c1-abb1-d5a5288c12ab tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /compute/v2.1/servers/f4f8081b-28f4-4e9f-bf48-471d84e67da8" status: 200 len: 1514 microversion: 2.1 time: 0.413266 May 26 15:01:28.693083 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 378/721] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:01:28 2021] GET /compute/v2.1/servers/f4f8081b-28f4-4e9f-bf48-471d84e67da8 => generated 1514 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:01:28.693266 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-4347f162-e497-43e0-b760-9da5e989ffe6 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:28.693753 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-4347f162-e497-43e0-b760-9da5e989ffe6 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:28.694547 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-4347f162-e497-43e0-b760-9da5e989ffe6 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:28.694980 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-4347f162-e497-43e0-b760-9da5e989ffe6 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:28.976557 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-7bbd7c6b-feb2-49d9-a3a2-2379d0be9a00 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:28.977403 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-7bbd7c6b-feb2-49d9-a3a2-2379d0be9a00 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] [instance: aa145a33-41b1-4e39-9642-132aca11fcfe] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:01:28.991981 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-7bbd7c6b-feb2-49d9-a3a2-2379d0be9a00 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:28.992809 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-7bbd7c6b-feb2-49d9-a3a2-2379d0be9a00 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:28.994061 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-7bbd7c6b-feb2-49d9-a3a2-2379d0be9a00 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:28.994679 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-7bbd7c6b-feb2-49d9-a3a2-2379d0be9a00 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:29.043644 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-4347f162-e497-43e0-b760-9da5e989ffe6 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c2fb208b56d4d52b59ac09873f16180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e8cac36a174b2eb5a6e53fdf25b4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:01:29.054571 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-4347f162-e497-43e0-b760-9da5e989ffe6 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59" status: 200 len: 1677 microversion: 2.1 time: 0.379384 May 26 15:01:29.055870 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 344/722] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:01:28 2021] GET /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59 => generated 1677 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:01:29.112250 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [req-1814f5fb-17c4-4462-b78a-6154865b9318 req-43dee6bc-3e99-409c-bcc1-e4825fecbeea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa145a33-41b1-4e39-9642-132aca11fcfe", "name": "network-vif-deleted", "tag": "be847840-0dc2-4457-bb7b-594e083f4912"}]} {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:01:29.114500 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 15:01:29.114500 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: warnings.warn(msg) May 26 15:01:29.133603 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [req-1814f5fb-17c4-4462-b78a-6154865b9318 req-43dee6bc-3e99-409c-bcc1-e4825fecbeea service nova] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:29.134801 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [req-1814f5fb-17c4-4462-b78a-6154865b9318 req-43dee6bc-3e99-409c-bcc1-e4825fecbeea service nova] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:29.135456 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-7bbd7c6b-feb2-49d9-a3a2-2379d0be9a00 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b167942c895345b186a3eda5c82175b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad2ab2705ca479ab4aaafe7c80de162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:01:29.145207 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-7bbd7c6b-feb2-49d9-a3a2-2379d0be9a00 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /compute/v2.1/servers/aa145a33-41b1-4e39-9642-132aca11fcfe" status: 200 len: 1479 microversion: 2.1 time: 0.172246 May 26 15:01:29.145822 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 379/723] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:01:28 2021] GET /compute/v2.1/servers/aa145a33-41b1-4e39-9642-132aca11fcfe => generated 1479 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:01:29.156446 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.compute.server_external_events [req-1814f5fb-17c4-4462-b78a-6154865b9318 req-43dee6bc-3e99-409c-bcc1-e4825fecbeea service nova] Creating event network-vif-deleted:be847840-0dc2-4457-bb7b-594e083f4912 for instance aa145a33-41b1-4e39-9642-132aca11fcfe on hv-cinder-78414 May 26 15:01:29.161609 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [req-1814f5fb-17c4-4462-b78a-6154865b9318 req-43dee6bc-3e99-409c-bcc1-e4825fecbeea service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053963 May 26 15:01:29.162970 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 345/724] 10.222.0.81 () {64 vars in 1318 bytes} [Wed May 26 15:01:29 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 15:01:29.658712 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-616ef6f7-b9c7-4e6b-8e9c-ccfc5616fefd tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:29.659328 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-616ef6f7-b9c7-4e6b-8e9c-ccfc5616fefd tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] [instance: 2d11ba61-751c-43a5-9a56-5638a6afe727] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:01:29.667143 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-616ef6f7-b9c7-4e6b-8e9c-ccfc5616fefd tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:29.667593 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-616ef6f7-b9c7-4e6b-8e9c-ccfc5616fefd tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:29.668379 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-616ef6f7-b9c7-4e6b-8e9c-ccfc5616fefd tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:29.668813 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-616ef6f7-b9c7-4e6b-8e9c-ccfc5616fefd tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:29.712554 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-cd898ba9-abc3-4fcd-bab9-15b36d826c38 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:29.713458 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-cd898ba9-abc3-4fcd-bab9-15b36d826c38 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] [instance: f4f8081b-28f4-4e9f-bf48-471d84e67da8] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:01:29.722083 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-cd898ba9-abc3-4fcd-bab9-15b36d826c38 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:29.722707 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-cd898ba9-abc3-4fcd-bab9-15b36d826c38 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:29.723663 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-cd898ba9-abc3-4fcd-bab9-15b36d826c38 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:29.724213 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-cd898ba9-abc3-4fcd-bab9-15b36d826c38 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:29.989814 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-cd898ba9-abc3-4fcd-bab9-15b36d826c38 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be4bd5c0f2a400da491bae101b48832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515325707f64d58a28f26451b2c74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:01:29.997729 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-616ef6f7-b9c7-4e6b-8e9c-ccfc5616fefd tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8604f942d44fec96828cc0b1ae5960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b729993a1944061bb0a708877c95a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:01:30.001426 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-cd898ba9-abc3-4fcd-bab9-15b36d826c38 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /compute/v2.1/servers/f4f8081b-28f4-4e9f-bf48-471d84e67da8" status: 200 len: 1514 microversion: 2.1 time: 0.292975 May 26 15:01:30.002559 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 346/725] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:01:29 2021] GET /compute/v2.1/servers/f4f8081b-28f4-4e9f-bf48-471d84e67da8 => generated 1514 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:01:30.011301 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-616ef6f7-b9c7-4e6b-8e9c-ccfc5616fefd tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] 10.222.0.81 "GET /compute/v2.1/servers/2d11ba61-751c-43a5-9a56-5638a6afe727" status: 200 len: 1319 microversion: 2.1 time: 0.356321 May 26 15:01:30.012789 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 380/726] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:01:29 2021] GET /compute/v2.1/servers/2d11ba61-751c-43a5-9a56-5638a6afe727 => generated 1319 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:01:30.076030 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-b13109a4-3fcc-488b-880b-c6d09997d06d tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:30.077381 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-b13109a4-3fcc-488b-880b-c6d09997d06d tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: a9d8f9a6-bd66-4caa-8662-4bb94655ae59] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:01:30.091789 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-b13109a4-3fcc-488b-880b-c6d09997d06d tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:30.098450 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-b13109a4-3fcc-488b-880b-c6d09997d06d tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:30.098450 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-b13109a4-3fcc-488b-880b-c6d09997d06d tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:30.098450 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-b13109a4-3fcc-488b-880b-c6d09997d06d tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:30.165077 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-2c965528-2806-49ff-9f56-4fefc71e90a6 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:30.166187 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-2c965528-2806-49ff-9f56-4fefc71e90a6 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] [instance: aa145a33-41b1-4e39-9642-132aca11fcfe] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:01:30.177838 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-2c965528-2806-49ff-9f56-4fefc71e90a6 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:30.178617 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-2c965528-2806-49ff-9f56-4fefc71e90a6 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:30.179600 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-2c965528-2806-49ff-9f56-4fefc71e90a6 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:30.180204 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-2c965528-2806-49ff-9f56-4fefc71e90a6 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:30.305408 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-2c965528-2806-49ff-9f56-4fefc71e90a6 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:30.306798 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-2c965528-2806-49ff-9f56-4fefc71e90a6 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:30.307421 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.objects.instance [None req-2c965528-2806-49ff-9f56-4fefc71e90a6 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lazy-loading 'fault' on Instance uuid aa145a33-41b1-4e39-9642-132aca11fcfe {{(pid=118513) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 26 15:01:30.401479 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-b13109a4-3fcc-488b-880b-c6d09997d06d tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c2fb208b56d4d52b59ac09873f16180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e8cac36a174b2eb5a6e53fdf25b4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:01:30.401950 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-2c965528-2806-49ff-9f56-4fefc71e90a6 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b167942c895345b186a3eda5c82175b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ad2ab2705ca479ab4aaafe7c80de162', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:01:30.411655 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-b13109a4-3fcc-488b-880b-c6d09997d06d tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59" status: 200 len: 1677 microversion: 2.1 time: 0.342213 May 26 15:01:30.413411 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-2c965528-2806-49ff-9f56-4fefc71e90a6 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /compute/v2.1/servers/aa145a33-41b1-4e39-9642-132aca11fcfe" status: 200 len: 1312 microversion: 2.1 time: 0.253901 May 26 15:01:30.414352 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 381/727] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:01:30 2021] GET /compute/v2.1/servers/aa145a33-41b1-4e39-9642-132aca11fcfe => generated 1312 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:01:30.417927 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 347/728] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:01:30 2021] GET /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59 => generated 1677 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:01:31.018376 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-e1ce4684-651d-4777-9f44-68bb55b3e7ad tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:31.019234 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-e1ce4684-651d-4777-9f44-68bb55b3e7ad tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] [instance: f4f8081b-28f4-4e9f-bf48-471d84e67da8] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:01:31.028231 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-28293f9e-edad-4a8e-bd05-4c59fc79b1c6 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:31.028989 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-28293f9e-edad-4a8e-bd05-4c59fc79b1c6 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] [instance: 2d11ba61-751c-43a5-9a56-5638a6afe727] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:01:31.043119 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-28293f9e-edad-4a8e-bd05-4c59fc79b1c6 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:31.043534 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-28293f9e-edad-4a8e-bd05-4c59fc79b1c6 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:31.044339 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-28293f9e-edad-4a8e-bd05-4c59fc79b1c6 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:31.044782 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-28293f9e-edad-4a8e-bd05-4c59fc79b1c6 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:31.045288 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-e1ce4684-651d-4777-9f44-68bb55b3e7ad tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:31.046608 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-e1ce4684-651d-4777-9f44-68bb55b3e7ad tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:31.048144 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-e1ce4684-651d-4777-9f44-68bb55b3e7ad tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:31.048823 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-e1ce4684-651d-4777-9f44-68bb55b3e7ad tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:31.293577 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-e1ce4684-651d-4777-9f44-68bb55b3e7ad tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be4bd5c0f2a400da491bae101b48832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515325707f64d58a28f26451b2c74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:01:31.306472 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-e1ce4684-651d-4777-9f44-68bb55b3e7ad tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /compute/v2.1/servers/f4f8081b-28f4-4e9f-bf48-471d84e67da8" status: 200 len: 1514 microversion: 2.1 time: 0.291686 May 26 15:01:31.307346 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 382/729] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:01:31 2021] GET /compute/v2.1/servers/f4f8081b-28f4-4e9f-bf48-471d84e67da8 => generated 1514 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:01:31.428956 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-e34be4ca-069f-4c84-8e47-c28b83e2c3e8 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:31.428956 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-e34be4ca-069f-4c84-8e47-c28b83e2c3e8 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: a9d8f9a6-bd66-4caa-8662-4bb94655ae59] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:01:31.436455 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-e34be4ca-069f-4c84-8e47-c28b83e2c3e8 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:31.437357 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-e34be4ca-069f-4c84-8e47-c28b83e2c3e8 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:31.437729 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-e34be4ca-069f-4c84-8e47-c28b83e2c3e8 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:31.438702 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-e34be4ca-069f-4c84-8e47-c28b83e2c3e8 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:31.529175 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-28293f9e-edad-4a8e-bd05-4c59fc79b1c6 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8604f942d44fec96828cc0b1ae5960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b729993a1944061bb0a708877c95a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:01:31.543563 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-28293f9e-edad-4a8e-bd05-4c59fc79b1c6 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] 10.222.0.81 "GET /compute/v2.1/servers/2d11ba61-751c-43a5-9a56-5638a6afe727" status: 200 len: 1508 microversion: 2.1 time: 0.519155 May 26 15:01:31.544403 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 348/730] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:01:31 2021] GET /compute/v2.1/servers/2d11ba61-751c-43a5-9a56-5638a6afe727 => generated 1508 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:01:31.548776 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-4b405bfa-ea79-47ee-b8ae-c7307928a3c6 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:31.549394 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-4b405bfa-ea79-47ee-b8ae-c7307928a3c6 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] [instance: aa145a33-41b1-4e39-9642-132aca11fcfe] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:01:31.557389 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-4b405bfa-ea79-47ee-b8ae-c7307928a3c6 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:31.566858 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-4b405bfa-ea79-47ee-b8ae-c7307928a3c6 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:31.566858 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-4b405bfa-ea79-47ee-b8ae-c7307928a3c6 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:31.566858 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-4b405bfa-ea79-47ee-b8ae-c7307928a3c6 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:31.645474 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.wsgi [None req-4b405bfa-ea79-47ee-b8ae-c7307928a3c6 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] HTTP exception thrown: Instance aa145a33-41b1-4e39-9642-132aca11fcfe could not be found. May 26 15:01:31.646119 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-4b405bfa-ea79-47ee-b8ae-c7307928a3c6 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] Returning 404 to user: Instance aa145a33-41b1-4e39-9642-132aca11fcfe could not be found. {{(pid=118514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 26 15:01:31.646962 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-4b405bfa-ea79-47ee-b8ae-c7307928a3c6 tempest-ServerRescueNegativeTestJSON-2132581990 tempest-ServerRescueNegativeTestJSON-2132581990-project] 10.222.0.81 "GET /compute/v2.1/servers/aa145a33-41b1-4e39-9642-132aca11fcfe" status: 404 len: 111 microversion: 2.1 time: 0.101802 May 26 15:01:31.651201 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 349/731] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:01:31 2021] GET /compute/v2.1/servers/aa145a33-41b1-4e39-9642-132aca11fcfe => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 15:01:31.670449 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-67bd41ea-4f76-4544-928d-3d511acbb8ae tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "64e9dd74-a558-4572-a526-4b810a06affd", "device": "/dev/sdb"}} {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:01:31.671460 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-67bd41ea-4f76-4544-928d-3d511acbb8ae tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] [instance: 2d11ba61-751c-43a5-9a56-5638a6afe727] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:01:31.708459 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-67bd41ea-4f76-4544-928d-3d511acbb8ae tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:31.708938 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-67bd41ea-4f76-4544-928d-3d511acbb8ae tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:31.709792 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-67bd41ea-4f76-4544-928d-3d511acbb8ae tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:31.710250 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-67bd41ea-4f76-4544-928d-3d511acbb8ae tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:31.754284 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-e34be4ca-069f-4c84-8e47-c28b83e2c3e8 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c2fb208b56d4d52b59ac09873f16180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e8cac36a174b2eb5a6e53fdf25b4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:01:31.763629 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-e34be4ca-069f-4c84-8e47-c28b83e2c3e8 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59" status: 200 len: 1677 microversion: 2.1 time: 0.339197 May 26 15:01:31.768359 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 383/732] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:01:31 2021] GET /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59 => generated 1677 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:01:31.853930 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [req-f86a4516-d465-4594-ad0f-4f47d6af7ffe req-34b803fa-d3d8-4836-93bc-ca98db1cc2ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4f8081b-28f4-4e9f-bf48-471d84e67da8", "name": "network-vif-deleted", "tag": "3ab2e391-3d42-467d-8e80-fe132717746c"}]} {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:01:31.857448 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 15:01:31.857448 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: warnings.warn(msg) May 26 15:01:31.870147 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [req-f86a4516-d465-4594-ad0f-4f47d6af7ffe req-34b803fa-d3d8-4836-93bc-ca98db1cc2ee service nova] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:31.870890 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [req-f86a4516-d465-4594-ad0f-4f47d6af7ffe req-34b803fa-d3d8-4836-93bc-ca98db1cc2ee service nova] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:31.894718 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.compute.server_external_events [req-f86a4516-d465-4594-ad0f-4f47d6af7ffe req-34b803fa-d3d8-4836-93bc-ca98db1cc2ee service nova] Creating event network-vif-deleted:3ab2e391-3d42-467d-8e80-fe132717746c for instance f4f8081b-28f4-4e9f-bf48-471d84e67da8 on hv-cinder-78414 May 26 15:01:31.900835 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [req-f86a4516-d465-4594-ad0f-4f47d6af7ffe req-34b803fa-d3d8-4836-93bc-ca98db1cc2ee service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051432 May 26 15:01:31.902602 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 384/733] 10.222.0.81 () {64 vars in 1318 bytes} [Wed May 26 15:01:31 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 15:01:32.326661 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-ab5c89ee-393d-449b-a76a-219f8c47c3ac tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:32.328327 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-ab5c89ee-393d-449b-a76a-219f8c47c3ac tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] [instance: f4f8081b-28f4-4e9f-bf48-471d84e67da8] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:01:32.342213 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-ab5c89ee-393d-449b-a76a-219f8c47c3ac tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:32.343076 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-ab5c89ee-393d-449b-a76a-219f8c47c3ac tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:32.344074 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-ab5c89ee-393d-449b-a76a-219f8c47c3ac tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:32.344763 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-ab5c89ee-393d-449b-a76a-219f8c47c3ac tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:32.422420 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-ab5c89ee-393d-449b-a76a-219f8c47c3ac tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:32.423517 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-ab5c89ee-393d-449b-a76a-219f8c47c3ac tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:32.424360 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.objects.instance [None req-ab5c89ee-393d-449b-a76a-219f8c47c3ac tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lazy-loading 'fault' on Instance uuid f4f8081b-28f4-4e9f-bf48-471d84e67da8 {{(pid=118513) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 26 15:01:32.502705 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-ab5c89ee-393d-449b-a76a-219f8c47c3ac tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be4bd5c0f2a400da491bae101b48832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515325707f64d58a28f26451b2c74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:01:32.523360 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-ab5c89ee-393d-449b-a76a-219f8c47c3ac tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /compute/v2.1/servers/f4f8081b-28f4-4e9f-bf48-471d84e67da8" status: 200 len: 1307 microversion: 2.1 time: 0.200581 May 26 15:01:32.527663 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 385/734] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:01:32 2021] GET /compute/v2.1/servers/f4f8081b-28f4-4e9f-bf48-471d84e67da8 => generated 1307 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:01:32.773473 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-67bd41ea-4f76-4544-928d-3d511acbb8ae tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] 10.222.0.81 "POST /compute/v2.1/servers/2d11ba61-751c-43a5-9a56-5638a6afe727/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.124168 May 26 15:01:32.782356 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-9bd1c971-5692-4287-86e3-84b1b2aa5dd4 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:32.783449 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-9bd1c971-5692-4287-86e3-84b1b2aa5dd4 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: a9d8f9a6-bd66-4caa-8662-4bb94655ae59] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:01:32.788478 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 350/735] 10.222.0.81 () {60 vars in 1323 bytes} [Wed May 26 15:01:31 2021] POST /compute/v2.1/servers/2d11ba61-751c-43a5-9a56-5638a6afe727/os-volume_attachments => generated 194 bytes in 1140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:01:32.795982 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-9bd1c971-5692-4287-86e3-84b1b2aa5dd4 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:32.797424 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-9bd1c971-5692-4287-86e3-84b1b2aa5dd4 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:32.799296 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-9bd1c971-5692-4287-86e3-84b1b2aa5dd4 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:32.799910 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-9bd1c971-5692-4287-86e3-84b1b2aa5dd4 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:33.171505 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-9bd1c971-5692-4287-86e3-84b1b2aa5dd4 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c2fb208b56d4d52b59ac09873f16180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e8cac36a174b2eb5a6e53fdf25b4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:01:33.189859 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-9bd1c971-5692-4287-86e3-84b1b2aa5dd4 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59" status: 200 len: 1677 microversion: 2.1 time: 0.403333 May 26 15:01:33.191893 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 386/736] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:01:32 2021] GET /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59 => generated 1677 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:01:33.548509 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-0063b75e-20a1-494a-a78b-9cd6ededa86b tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:33.550015 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-0063b75e-20a1-494a-a78b-9cd6ededa86b tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] [instance: f4f8081b-28f4-4e9f-bf48-471d84e67da8] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:01:33.558888 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-0063b75e-20a1-494a-a78b-9cd6ededa86b tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:33.559724 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-0063b75e-20a1-494a-a78b-9cd6ededa86b tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:33.560657 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-0063b75e-20a1-494a-a78b-9cd6ededa86b tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:33.561112 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-0063b75e-20a1-494a-a78b-9cd6ededa86b tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:33.635166 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.wsgi [None req-0063b75e-20a1-494a-a78b-9cd6ededa86b tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] HTTP exception thrown: Instance f4f8081b-28f4-4e9f-bf48-471d84e67da8 could not be found. May 26 15:01:33.636501 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-0063b75e-20a1-494a-a78b-9cd6ededa86b tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Returning 404 to user: Instance f4f8081b-28f4-4e9f-bf48-471d84e67da8 could not be found. {{(pid=118514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 26 15:01:33.638043 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-0063b75e-20a1-494a-a78b-9cd6ededa86b tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /compute/v2.1/servers/f4f8081b-28f4-4e9f-bf48-471d84e67da8" status: 404 len: 111 microversion: 2.1 time: 0.095732 May 26 15:01:33.640404 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 351/737] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:01:33 2021] GET /compute/v2.1/servers/f4f8081b-28f4-4e9f-bf48-471d84e67da8 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 15:01:33.648615 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-aabb7cde-5e11-49a1-adf6-44b8a79478eb tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:33.649746 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-aabb7cde-5e11-49a1-adf6-44b8a79478eb tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] [instance: 811eac08-9039-4d9e-a76f-fa4d6033f5a6] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:01:33.658225 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-aabb7cde-5e11-49a1-adf6-44b8a79478eb tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:33.659007 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-aabb7cde-5e11-49a1-adf6-44b8a79478eb tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:33.660020 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-aabb7cde-5e11-49a1-adf6-44b8a79478eb tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:33.660678 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-aabb7cde-5e11-49a1-adf6-44b8a79478eb tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:33.729080 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-aabb7cde-5e11-49a1-adf6-44b8a79478eb tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] [instance: 811eac08-9039-4d9e-a76f-fa4d6033f5a6] Going to try to terminate instance {{(pid=118513) delete /opt/stack/nova/nova/compute/api.py:2539}} May 26 15:01:34.013687 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-aabb7cde-5e11-49a1-adf6-44b8a79478eb tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "DELETE /compute/v2.1/servers/811eac08-9039-4d9e-a76f-fa4d6033f5a6" status: 204 len: 0 microversion: 2.1 time: 0.368303 May 26 15:01:34.014818 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 387/738] 10.222.0.81 () {58 vars in 1239 bytes} [Wed May 26 15:01:33 2021] DELETE /compute/v2.1/servers/811eac08-9039-4d9e-a76f-fa4d6033f5a6 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 15:01:34.040109 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-d939844a-7b0f-4049-8ac7-18368d38945d tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:34.044018 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-d939844a-7b0f-4049-8ac7-18368d38945d tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] [instance: 811eac08-9039-4d9e-a76f-fa4d6033f5a6] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:01:34.058857 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-d939844a-7b0f-4049-8ac7-18368d38945d tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:34.062125 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-d939844a-7b0f-4049-8ac7-18368d38945d tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:34.066312 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-d939844a-7b0f-4049-8ac7-18368d38945d tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:34.067396 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-d939844a-7b0f-4049-8ac7-18368d38945d tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:34.214049 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-28d53137-bfdd-4166-b2ac-8caf800bfe7e tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:34.215587 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-28d53137-bfdd-4166-b2ac-8caf800bfe7e tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: a9d8f9a6-bd66-4caa-8662-4bb94655ae59] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:01:34.237045 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-28d53137-bfdd-4166-b2ac-8caf800bfe7e tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:34.237883 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-28d53137-bfdd-4166-b2ac-8caf800bfe7e tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:34.238890 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-28d53137-bfdd-4166-b2ac-8caf800bfe7e tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:34.239539 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-28d53137-bfdd-4166-b2ac-8caf800bfe7e tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:34.513404 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-d939844a-7b0f-4049-8ac7-18368d38945d tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be4bd5c0f2a400da491bae101b48832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515325707f64d58a28f26451b2c74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:01:34.525321 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-d939844a-7b0f-4049-8ac7-18368d38945d tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /compute/v2.1/servers/811eac08-9039-4d9e-a76f-fa4d6033f5a6" status: 200 len: 1514 microversion: 2.1 time: 0.495509 May 26 15:01:34.526320 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 352/739] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:01:34 2021] GET /compute/v2.1/servers/811eac08-9039-4d9e-a76f-fa4d6033f5a6 => generated 1514 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:01:34.728845 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-28d53137-bfdd-4166-b2ac-8caf800bfe7e tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c2fb208b56d4d52b59ac09873f16180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e8cac36a174b2eb5a6e53fdf25b4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:01:34.744011 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-28d53137-bfdd-4166-b2ac-8caf800bfe7e tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59" status: 200 len: 1677 microversion: 2.1 time: 0.533969 May 26 15:01:34.745011 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 388/740] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:01:34 2021] GET /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59 => generated 1677 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:01:35.550527 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-8c4c230a-318f-4204-a938-fba287211795 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:35.551697 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-8c4c230a-318f-4204-a938-fba287211795 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] [instance: 811eac08-9039-4d9e-a76f-fa4d6033f5a6] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:01:35.567699 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-8c4c230a-318f-4204-a938-fba287211795 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:35.569831 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-8c4c230a-318f-4204-a938-fba287211795 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:35.570942 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-8c4c230a-318f-4204-a938-fba287211795 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:35.572018 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-8c4c230a-318f-4204-a938-fba287211795 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:35.767318 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-3c48860e-7e59-4b18-85c6-85e7048e336a tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:35.770818 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-3c48860e-7e59-4b18-85c6-85e7048e336a tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: a9d8f9a6-bd66-4caa-8662-4bb94655ae59] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:01:35.780687 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-3c48860e-7e59-4b18-85c6-85e7048e336a tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:35.781587 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-3c48860e-7e59-4b18-85c6-85e7048e336a tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:35.783372 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-3c48860e-7e59-4b18-85c6-85e7048e336a tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:35.784068 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-3c48860e-7e59-4b18-85c6-85e7048e336a tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:35.924635 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-8c4c230a-318f-4204-a938-fba287211795 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be4bd5c0f2a400da491bae101b48832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515325707f64d58a28f26451b2c74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:01:35.935613 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-8c4c230a-318f-4204-a938-fba287211795 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /compute/v2.1/servers/811eac08-9039-4d9e-a76f-fa4d6033f5a6" status: 200 len: 1514 microversion: 2.1 time: 0.391301 May 26 15:01:35.936399 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 353/741] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:01:35 2021] GET /compute/v2.1/servers/811eac08-9039-4d9e-a76f-fa4d6033f5a6 => generated 1514 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:01:36.272638 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-3c48860e-7e59-4b18-85c6-85e7048e336a tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c2fb208b56d4d52b59ac09873f16180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e8cac36a174b2eb5a6e53fdf25b4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:01:36.281463 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-3c48860e-7e59-4b18-85c6-85e7048e336a tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59" status: 200 len: 1677 microversion: 2.1 time: 0.518360 May 26 15:01:36.287782 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 389/742] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:01:35 2021] GET /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59 => generated 1677 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:01:36.925329 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [req-7759b1a8-f142-4046-b4d3-cea7ed1220e6 req-88884252-e223-4dae-ad82-7494b589854a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "811eac08-9039-4d9e-a76f-fa4d6033f5a6", "name": "network-vif-deleted", "tag": "569fad69-3482-4ba8-829b-ffd9c0bc4482"}]} {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:01:36.928012 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 15:01:36.928012 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: warnings.warn(msg) May 26 15:01:36.942216 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [req-7759b1a8-f142-4046-b4d3-cea7ed1220e6 req-88884252-e223-4dae-ad82-7494b589854a service nova] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:36.942672 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [req-7759b1a8-f142-4046-b4d3-cea7ed1220e6 req-88884252-e223-4dae-ad82-7494b589854a service nova] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:36.956492 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-97ed1bc6-57bd-4b24-a39c-e944e0752cef tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:36.957045 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-97ed1bc6-57bd-4b24-a39c-e944e0752cef tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] [instance: 811eac08-9039-4d9e-a76f-fa4d6033f5a6] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:01:36.962582 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.compute.server_external_events [req-7759b1a8-f142-4046-b4d3-cea7ed1220e6 req-88884252-e223-4dae-ad82-7494b589854a service nova] Creating event network-vif-deleted:569fad69-3482-4ba8-829b-ffd9c0bc4482 for instance 811eac08-9039-4d9e-a76f-fa4d6033f5a6 on hv-cinder-78414 May 26 15:01:36.968931 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-97ed1bc6-57bd-4b24-a39c-e944e0752cef tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:36.969936 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-97ed1bc6-57bd-4b24-a39c-e944e0752cef tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:36.970371 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [req-7759b1a8-f142-4046-b4d3-cea7ed1220e6 req-88884252-e223-4dae-ad82-7494b589854a service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051145 May 26 15:01:36.971306 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 354/743] 10.222.0.81 () {64 vars in 1318 bytes} [Wed May 26 15:01:36 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 15:01:36.971492 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-97ed1bc6-57bd-4b24-a39c-e944e0752cef tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:36.971944 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-97ed1bc6-57bd-4b24-a39c-e944e0752cef tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:37.165634 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-97ed1bc6-57bd-4b24-a39c-e944e0752cef tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be4bd5c0f2a400da491bae101b48832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515325707f64d58a28f26451b2c74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:01:37.179701 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-97ed1bc6-57bd-4b24-a39c-e944e0752cef tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /compute/v2.1/servers/811eac08-9039-4d9e-a76f-fa4d6033f5a6" status: 200 len: 1472 microversion: 2.1 time: 0.227863 May 26 15:01:37.180296 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 390/744] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:01:36 2021] GET /compute/v2.1/servers/811eac08-9039-4d9e-a76f-fa4d6033f5a6 => generated 1472 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:01:37.304798 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-77a205a2-ced7-48b0-a3dd-683d50ba6e85 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:37.305499 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-77a205a2-ced7-48b0-a3dd-683d50ba6e85 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: a9d8f9a6-bd66-4caa-8662-4bb94655ae59] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:01:37.312920 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-77a205a2-ced7-48b0-a3dd-683d50ba6e85 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:37.314161 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-77a205a2-ced7-48b0-a3dd-683d50ba6e85 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:37.314690 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-77a205a2-ced7-48b0-a3dd-683d50ba6e85 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:37.315126 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-77a205a2-ced7-48b0-a3dd-683d50ba6e85 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:37.513425 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-77a205a2-ced7-48b0-a3dd-683d50ba6e85 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c2fb208b56d4d52b59ac09873f16180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e8cac36a174b2eb5a6e53fdf25b4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:01:37.523069 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-77a205a2-ced7-48b0-a3dd-683d50ba6e85 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59" status: 200 len: 1677 microversion: 2.1 time: 0.222366 May 26 15:01:37.523655 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 355/745] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:01:37 2021] GET /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59 => generated 1677 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:01:38.196127 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-4ac56539-6a84-45f0-98c6-06cc8fa63411 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:38.196904 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-4ac56539-6a84-45f0-98c6-06cc8fa63411 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] [instance: 811eac08-9039-4d9e-a76f-fa4d6033f5a6] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:01:38.205568 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-4ac56539-6a84-45f0-98c6-06cc8fa63411 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:38.206283 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-4ac56539-6a84-45f0-98c6-06cc8fa63411 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:38.207041 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-4ac56539-6a84-45f0-98c6-06cc8fa63411 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:38.207771 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-4ac56539-6a84-45f0-98c6-06cc8fa63411 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:38.266370 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.wsgi [None req-4ac56539-6a84-45f0-98c6-06cc8fa63411 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] HTTP exception thrown: Instance 811eac08-9039-4d9e-a76f-fa4d6033f5a6 could not be found. May 26 15:01:38.266987 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-4ac56539-6a84-45f0-98c6-06cc8fa63411 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Returning 404 to user: Instance 811eac08-9039-4d9e-a76f-fa4d6033f5a6 could not be found. {{(pid=118513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 26 15:01:38.268003 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-4ac56539-6a84-45f0-98c6-06cc8fa63411 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /compute/v2.1/servers/811eac08-9039-4d9e-a76f-fa4d6033f5a6" status: 404 len: 111 microversion: 2.1 time: 0.075815 May 26 15:01:38.269704 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 391/746] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:01:38 2021] GET /compute/v2.1/servers/811eac08-9039-4d9e-a76f-fa4d6033f5a6 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 15:01:38.545800 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-12383201-d595-4cde-91b6-9c7c88e6933e tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:38.546496 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-12383201-d595-4cde-91b6-9c7c88e6933e tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: a9d8f9a6-bd66-4caa-8662-4bb94655ae59] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:01:38.557420 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-12383201-d595-4cde-91b6-9c7c88e6933e tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:38.558194 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-12383201-d595-4cde-91b6-9c7c88e6933e tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:38.558992 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-12383201-d595-4cde-91b6-9c7c88e6933e tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:38.559442 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-12383201-d595-4cde-91b6-9c7c88e6933e tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:38.832891 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-12383201-d595-4cde-91b6-9c7c88e6933e tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c2fb208b56d4d52b59ac09873f16180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e8cac36a174b2eb5a6e53fdf25b4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:01:38.842706 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-12383201-d595-4cde-91b6-9c7c88e6933e tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59" status: 200 len: 1677 microversion: 2.1 time: 0.302800 May 26 15:01:38.843286 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 356/747] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:01:38 2021] GET /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59 => generated 1677 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:01:39.606561 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-1bfc2c97-7a36-43be-948d-dfa1df72096b tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:39.607070 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-1bfc2c97-7a36-43be-948d-dfa1df72096b tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] [instance: 396d0570-c547-4549-8fe6-dd156ef64c4b] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:01:39.614831 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-1bfc2c97-7a36-43be-948d-dfa1df72096b tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:39.615310 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-1bfc2c97-7a36-43be-948d-dfa1df72096b tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:39.616080 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-1bfc2c97-7a36-43be-948d-dfa1df72096b tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:39.616565 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-1bfc2c97-7a36-43be-948d-dfa1df72096b tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:39.680830 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-1bfc2c97-7a36-43be-948d-dfa1df72096b tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] [instance: 396d0570-c547-4549-8fe6-dd156ef64c4b] Going to try to terminate instance {{(pid=118513) delete /opt/stack/nova/nova/compute/api.py:2539}} May 26 15:01:39.861365 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-fd9fe8f7-03d1-4903-a0e2-27952f133ba4 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:39.862817 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-fd9fe8f7-03d1-4903-a0e2-27952f133ba4 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: a9d8f9a6-bd66-4caa-8662-4bb94655ae59] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:01:39.871089 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-fd9fe8f7-03d1-4903-a0e2-27952f133ba4 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:39.871932 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-fd9fe8f7-03d1-4903-a0e2-27952f133ba4 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:39.872735 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-fd9fe8f7-03d1-4903-a0e2-27952f133ba4 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:39.873183 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-fd9fe8f7-03d1-4903-a0e2-27952f133ba4 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:40.077257 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-fd9fe8f7-03d1-4903-a0e2-27952f133ba4 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c2fb208b56d4d52b59ac09873f16180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e8cac36a174b2eb5a6e53fdf25b4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:01:40.086095 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-fd9fe8f7-03d1-4903-a0e2-27952f133ba4 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59" status: 200 len: 1677 microversion: 2.1 time: 0.229907 May 26 15:01:40.086657 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 357/748] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:01:39 2021] GET /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59 => generated 1677 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:01:40.131709 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-1bfc2c97-7a36-43be-948d-dfa1df72096b tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "DELETE /compute/v2.1/servers/396d0570-c547-4549-8fe6-dd156ef64c4b" status: 204 len: 0 microversion: 2.1 time: 0.528208 May 26 15:01:40.132558 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 392/749] 10.222.0.81 () {58 vars in 1239 bytes} [Wed May 26 15:01:39 2021] DELETE /compute/v2.1/servers/396d0570-c547-4549-8fe6-dd156ef64c4b => generated 0 bytes in 530 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 26 15:01:40.141762 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-384327bd-6327-48c0-ac2d-11b325ae5b2d tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:40.142428 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-384327bd-6327-48c0-ac2d-11b325ae5b2d tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] [instance: 396d0570-c547-4549-8fe6-dd156ef64c4b] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:01:40.149477 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-384327bd-6327-48c0-ac2d-11b325ae5b2d tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:40.149952 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-384327bd-6327-48c0-ac2d-11b325ae5b2d tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:40.151019 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-384327bd-6327-48c0-ac2d-11b325ae5b2d tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:40.151452 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-384327bd-6327-48c0-ac2d-11b325ae5b2d tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:40.446482 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-384327bd-6327-48c0-ac2d-11b325ae5b2d tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be4bd5c0f2a400da491bae101b48832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515325707f64d58a28f26451b2c74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:01:40.455809 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-384327bd-6327-48c0-ac2d-11b325ae5b2d tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /compute/v2.1/servers/396d0570-c547-4549-8fe6-dd156ef64c4b" status: 200 len: 1513 microversion: 2.1 time: 0.318417 May 26 15:01:40.457883 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 358/750] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:01:40 2021] GET /compute/v2.1/servers/396d0570-c547-4549-8fe6-dd156ef64c4b => generated 1513 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:01:41.103942 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-93c94835-47d5-4d74-801a-e48291b40cff tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:41.104653 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-93c94835-47d5-4d74-801a-e48291b40cff tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: a9d8f9a6-bd66-4caa-8662-4bb94655ae59] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:01:41.113036 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-93c94835-47d5-4d74-801a-e48291b40cff tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:41.113722 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-93c94835-47d5-4d74-801a-e48291b40cff tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:41.114519 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-93c94835-47d5-4d74-801a-e48291b40cff tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:41.115415 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-93c94835-47d5-4d74-801a-e48291b40cff tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:41.334252 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-93c94835-47d5-4d74-801a-e48291b40cff tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c2fb208b56d4d52b59ac09873f16180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e8cac36a174b2eb5a6e53fdf25b4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:01:41.346642 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-93c94835-47d5-4d74-801a-e48291b40cff tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59" status: 200 len: 1677 microversion: 2.1 time: 0.246678 May 26 15:01:41.347540 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 393/751] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:01:41 2021] GET /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59 => generated 1677 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:01:41.472787 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-271478d7-157c-4d82-8fa3-e1a839d8e3bf tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:41.473425 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-271478d7-157c-4d82-8fa3-e1a839d8e3bf tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] [instance: 396d0570-c547-4549-8fe6-dd156ef64c4b] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:01:41.480932 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-271478d7-157c-4d82-8fa3-e1a839d8e3bf tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:41.481392 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-271478d7-157c-4d82-8fa3-e1a839d8e3bf tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:41.482251 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-271478d7-157c-4d82-8fa3-e1a839d8e3bf tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:41.482727 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-271478d7-157c-4d82-8fa3-e1a839d8e3bf tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:41.976614 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-271478d7-157c-4d82-8fa3-e1a839d8e3bf tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be4bd5c0f2a400da491bae101b48832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515325707f64d58a28f26451b2c74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:01:41.985055 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-271478d7-157c-4d82-8fa3-e1a839d8e3bf tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /compute/v2.1/servers/396d0570-c547-4549-8fe6-dd156ef64c4b" status: 200 len: 1513 microversion: 2.1 time: 0.516685 May 26 15:01:41.985644 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 359/752] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:01:41 2021] GET /compute/v2.1/servers/396d0570-c547-4549-8fe6-dd156ef64c4b => generated 1513 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:01:42.363932 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-4b2bc73c-e097-4f3f-b2a1-940b60573ff7 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:42.364467 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-4b2bc73c-e097-4f3f-b2a1-940b60573ff7 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: a9d8f9a6-bd66-4caa-8662-4bb94655ae59] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:01:42.371655 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-4b2bc73c-e097-4f3f-b2a1-940b60573ff7 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:42.372106 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-4b2bc73c-e097-4f3f-b2a1-940b60573ff7 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:42.372872 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-4b2bc73c-e097-4f3f-b2a1-940b60573ff7 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:42.373309 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-4b2bc73c-e097-4f3f-b2a1-940b60573ff7 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:42.576049 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-4b2bc73c-e097-4f3f-b2a1-940b60573ff7 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c2fb208b56d4d52b59ac09873f16180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e8cac36a174b2eb5a6e53fdf25b4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:01:42.584611 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-4b2bc73c-e097-4f3f-b2a1-940b60573ff7 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59" status: 200 len: 1677 microversion: 2.1 time: 0.225433 May 26 15:01:42.590815 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 394/753] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:01:42 2021] GET /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59 => generated 1677 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:01:43.001936 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-bd57f372-027d-4cb4-9eba-7f46f32bb79e tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:43.002557 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-bd57f372-027d-4cb4-9eba-7f46f32bb79e tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] [instance: 396d0570-c547-4549-8fe6-dd156ef64c4b] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:01:43.009978 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-bd57f372-027d-4cb4-9eba-7f46f32bb79e tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:43.010426 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-bd57f372-027d-4cb4-9eba-7f46f32bb79e tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:43.011263 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-bd57f372-027d-4cb4-9eba-7f46f32bb79e tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:43.011705 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-bd57f372-027d-4cb4-9eba-7f46f32bb79e tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:43.212300 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-bd57f372-027d-4cb4-9eba-7f46f32bb79e tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be4bd5c0f2a400da491bae101b48832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515325707f64d58a28f26451b2c74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:01:43.221964 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-bd57f372-027d-4cb4-9eba-7f46f32bb79e tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /compute/v2.1/servers/396d0570-c547-4549-8fe6-dd156ef64c4b" status: 200 len: 1513 microversion: 2.1 time: 0.223973 May 26 15:01:43.222647 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 360/754] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:01:42 2021] GET /compute/v2.1/servers/396d0570-c547-4549-8fe6-dd156ef64c4b => generated 1513 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:01:43.604758 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-fc2ef524-61c1-45f6-a0ca-2894b0234b49 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:43.605454 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-fc2ef524-61c1-45f6-a0ca-2894b0234b49 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: a9d8f9a6-bd66-4caa-8662-4bb94655ae59] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:01:43.613439 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-fc2ef524-61c1-45f6-a0ca-2894b0234b49 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:43.613928 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-fc2ef524-61c1-45f6-a0ca-2894b0234b49 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:43.614709 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-fc2ef524-61c1-45f6-a0ca-2894b0234b49 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:43.615150 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-fc2ef524-61c1-45f6-a0ca-2894b0234b49 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:43.821520 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-fc2ef524-61c1-45f6-a0ca-2894b0234b49 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c2fb208b56d4d52b59ac09873f16180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e8cac36a174b2eb5a6e53fdf25b4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:01:43.830427 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-fc2ef524-61c1-45f6-a0ca-2894b0234b49 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59" status: 200 len: 1677 microversion: 2.1 time: 0.229354 May 26 15:01:43.830999 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 395/755] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:01:43 2021] GET /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59 => generated 1677 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:01:44.239294 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-574f404b-4b1e-4678-8a64-a42a7b0e49c2 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:44.239946 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-574f404b-4b1e-4678-8a64-a42a7b0e49c2 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] [instance: 396d0570-c547-4549-8fe6-dd156ef64c4b] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:01:44.247086 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-574f404b-4b1e-4678-8a64-a42a7b0e49c2 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:44.247581 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-574f404b-4b1e-4678-8a64-a42a7b0e49c2 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:44.248367 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-574f404b-4b1e-4678-8a64-a42a7b0e49c2 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:44.248819 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-574f404b-4b1e-4678-8a64-a42a7b0e49c2 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:44.445428 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-574f404b-4b1e-4678-8a64-a42a7b0e49c2 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be4bd5c0f2a400da491bae101b48832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515325707f64d58a28f26451b2c74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:01:44.454833 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-574f404b-4b1e-4678-8a64-a42a7b0e49c2 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /compute/v2.1/servers/396d0570-c547-4549-8fe6-dd156ef64c4b" status: 200 len: 1513 microversion: 2.1 time: 0.219507 May 26 15:01:44.455348 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 361/756] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:01:44 2021] GET /compute/v2.1/servers/396d0570-c547-4549-8fe6-dd156ef64c4b => generated 1513 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:01:44.847798 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-1dd4b546-8736-4b08-9cd8-971cb298e079 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:44.848404 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-1dd4b546-8736-4b08-9cd8-971cb298e079 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: a9d8f9a6-bd66-4caa-8662-4bb94655ae59] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:01:44.855718 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-1dd4b546-8736-4b08-9cd8-971cb298e079 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:44.856167 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-1dd4b546-8736-4b08-9cd8-971cb298e079 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:44.856937 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-1dd4b546-8736-4b08-9cd8-971cb298e079 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:44.857377 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-1dd4b546-8736-4b08-9cd8-971cb298e079 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:45.070943 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-1dd4b546-8736-4b08-9cd8-971cb298e079 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c2fb208b56d4d52b59ac09873f16180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e8cac36a174b2eb5a6e53fdf25b4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:01:45.082285 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-1dd4b546-8736-4b08-9cd8-971cb298e079 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59" status: 200 len: 1677 microversion: 2.1 time: 0.237822 May 26 15:01:45.083309 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 396/757] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:01:44 2021] GET /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59 => generated 1677 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:01:45.472264 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-f3c164ad-6604-41e9-bfe4-3b879c21f637 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:45.472953 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-f3c164ad-6604-41e9-bfe4-3b879c21f637 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] [instance: 396d0570-c547-4549-8fe6-dd156ef64c4b] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:01:45.480168 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-f3c164ad-6604-41e9-bfe4-3b879c21f637 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:45.480852 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-f3c164ad-6604-41e9-bfe4-3b879c21f637 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:45.481661 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-f3c164ad-6604-41e9-bfe4-3b879c21f637 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:45.482098 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-f3c164ad-6604-41e9-bfe4-3b879c21f637 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:45.715924 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-f3c164ad-6604-41e9-bfe4-3b879c21f637 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be4bd5c0f2a400da491bae101b48832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515325707f64d58a28f26451b2c74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:01:45.725132 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-f3c164ad-6604-41e9-bfe4-3b879c21f637 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /compute/v2.1/servers/396d0570-c547-4549-8fe6-dd156ef64c4b" status: 200 len: 1513 microversion: 2.1 time: 0.257248 May 26 15:01:45.725743 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 362/758] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:01:45 2021] GET /compute/v2.1/servers/396d0570-c547-4549-8fe6-dd156ef64c4b => generated 1513 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:01:45.869677 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [req-7914415b-e361-4028-836c-8dcb8a158342 req-cff58bff-15a4-4811-a547-d7a24834ba8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "396d0570-c547-4549-8fe6-dd156ef64c4b", "name": "network-vif-deleted", "tag": "5969b659-5456-4b6d-84cd-6a9fdbac70df"}]} {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:01:45.871813 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 15:01:45.871813 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: warnings.warn(msg) May 26 15:01:45.880276 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [req-7914415b-e361-4028-836c-8dcb8a158342 req-cff58bff-15a4-4811-a547-d7a24834ba8a service nova] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:45.880713 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [req-7914415b-e361-4028-836c-8dcb8a158342 req-cff58bff-15a4-4811-a547-d7a24834ba8a service nova] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:45.897101 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.compute.server_external_events [req-7914415b-e361-4028-836c-8dcb8a158342 req-cff58bff-15a4-4811-a547-d7a24834ba8a service nova] Creating event network-vif-deleted:5969b659-5456-4b6d-84cd-6a9fdbac70df for instance 396d0570-c547-4549-8fe6-dd156ef64c4b on hv-cinder-78414 May 26 15:01:45.902097 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [req-7914415b-e361-4028-836c-8dcb8a158342 req-cff58bff-15a4-4811-a547-d7a24834ba8a service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036325 May 26 15:01:45.902745 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 397/759] 10.222.0.81 () {64 vars in 1318 bytes} [Wed May 26 15:01:45 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:01:46.101237 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-5eae1b6f-e919-478f-9a6f-00f55d89ae1a tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:46.103660 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-5eae1b6f-e919-478f-9a6f-00f55d89ae1a tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: a9d8f9a6-bd66-4caa-8662-4bb94655ae59] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:01:46.111024 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-5eae1b6f-e919-478f-9a6f-00f55d89ae1a tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:46.111447 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-5eae1b6f-e919-478f-9a6f-00f55d89ae1a tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:46.112393 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-5eae1b6f-e919-478f-9a6f-00f55d89ae1a tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:46.112813 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-5eae1b6f-e919-478f-9a6f-00f55d89ae1a tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:46.236008 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-ea0cfac1-271d-41ba-ba59-664a1858bfe5 tempest-VolumesTestJSON-1649898350 tempest-VolumesTestJSON-1649898350-project] Calling method '.version_select at 0x7f441d9ffee0>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:46.326353 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-5eae1b6f-e919-478f-9a6f-00f55d89ae1a tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c2fb208b56d4d52b59ac09873f16180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e8cac36a174b2eb5a6e53fdf25b4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:01:46.331350 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-ea0cfac1-271d-41ba-ba59-664a1858bfe5 tempest-VolumesTestJSON-1649898350 tempest-VolumesTestJSON-1649898350-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/311af098-e024-4c42-9687-f00a4c5033ba" status: 200 len: 350 microversion: 2.1 time: 0.099357 May 26 15:01:46.331914 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 398/760] 10.222.0.81 () {58 vars in 1245 bytes} [Wed May 26 15:01:46 2021] GET /compute/v2.1/os-volumes/311af098-e024-4c42-9687-f00a4c5033ba => generated 350 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 15:01:46.335252 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-5eae1b6f-e919-478f-9a6f-00f55d89ae1a tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59" status: 200 len: 1654 microversion: 2.1 time: 0.237857 May 26 15:01:46.335827 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 363/761] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:01:46 2021] GET /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59 => generated 1654 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:01:46.350964 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-73868582-7497-4470-8aca-a92eb1c3496c tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:01:46.359712 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-73868582-7497-4470-8aca-a92eb1c3496c tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:46.359712 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-73868582-7497-4470-8aca-a92eb1c3496c tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:46.421189 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-73868582-7497-4470-8aca-a92eb1c3496c tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: a9d8f9a6-bd66-4caa-8662-4bb94655ae59] Going to try to start instance {{(pid=118513) start /opt/stack/nova/nova/compute/api.py:2602}} May 26 15:01:46.690837 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-73868582-7497-4470-8aca-a92eb1c3496c tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "POST /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59/action" status: 202 len: 0 microversion: 2.1 time: 0.343388 May 26 15:01:46.691439 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 399/762] 10.222.0.81 () {60 vars in 1278 bytes} [Wed May 26 15:01:46 2021] POST /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59/action => generated 0 bytes in 345 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 15:01:46.699754 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-c16b16cc-a32f-4c18-9179-46c5c2c2064a tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:46.700403 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-c16b16cc-a32f-4c18-9179-46c5c2c2064a tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: a9d8f9a6-bd66-4caa-8662-4bb94655ae59] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:01:46.708011 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-c16b16cc-a32f-4c18-9179-46c5c2c2064a tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:46.708463 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-c16b16cc-a32f-4c18-9179-46c5c2c2064a tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:46.709328 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-c16b16cc-a32f-4c18-9179-46c5c2c2064a tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:46.709817 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-c16b16cc-a32f-4c18-9179-46c5c2c2064a tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:46.742556 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-ea0d353e-bc22-4fd6-a36f-635d962f901d tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:46.744934 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-ea0d353e-bc22-4fd6-a36f-635d962f901d tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] [instance: 396d0570-c547-4549-8fe6-dd156ef64c4b] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:01:46.751615 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-ea0d353e-bc22-4fd6-a36f-635d962f901d tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:46.752147 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-ea0d353e-bc22-4fd6-a36f-635d962f901d tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:46.752988 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-ea0d353e-bc22-4fd6-a36f-635d962f901d tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:46.753654 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-ea0d353e-bc22-4fd6-a36f-635d962f901d tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:46.830160 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-ea0d353e-bc22-4fd6-a36f-635d962f901d tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:46.830830 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-ea0d353e-bc22-4fd6-a36f-635d962f901d tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:46.831463 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.objects.instance [None req-ea0d353e-bc22-4fd6-a36f-635d962f901d tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lazy-loading 'fault' on Instance uuid 396d0570-c547-4549-8fe6-dd156ef64c4b {{(pid=118513) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 26 15:01:46.895139 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-ea0d353e-bc22-4fd6-a36f-635d962f901d tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be4bd5c0f2a400da491bae101b48832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515325707f64d58a28f26451b2c74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:01:46.904457 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-ea0d353e-bc22-4fd6-a36f-635d962f901d tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /compute/v2.1/servers/396d0570-c547-4549-8fe6-dd156ef64c4b" status: 200 len: 1307 microversion: 2.1 time: 0.165907 May 26 15:01:46.905039 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 400/763] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:01:46 2021] GET /compute/v2.1/servers/396d0570-c547-4549-8fe6-dd156ef64c4b => generated 1307 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:01:46.924978 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-c16b16cc-a32f-4c18-9179-46c5c2c2064a tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c2fb208b56d4d52b59ac09873f16180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e8cac36a174b2eb5a6e53fdf25b4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:01:46.933316 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-c16b16cc-a32f-4c18-9179-46c5c2c2064a tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59" status: 200 len: 1663 microversion: 2.1 time: 0.237416 May 26 15:01:46.933942 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 364/764] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:01:46 2021] GET /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59 => generated 1663 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:01:47.924112 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-9905ce45-8846-47fa-a26b-dd79205aab27 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:47.924732 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-9905ce45-8846-47fa-a26b-dd79205aab27 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] [instance: 396d0570-c547-4549-8fe6-dd156ef64c4b] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:01:47.932046 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-9905ce45-8846-47fa-a26b-dd79205aab27 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:47.932500 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-9905ce45-8846-47fa-a26b-dd79205aab27 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:47.933275 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-9905ce45-8846-47fa-a26b-dd79205aab27 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:47.933755 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-9905ce45-8846-47fa-a26b-dd79205aab27 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:47.949332 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-8570ac0f-c9e3-4c94-a38a-e40e22a14254 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:47.951444 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-8570ac0f-c9e3-4c94-a38a-e40e22a14254 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: a9d8f9a6-bd66-4caa-8662-4bb94655ae59] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:01:47.957992 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-8570ac0f-c9e3-4c94-a38a-e40e22a14254 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:47.958453 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-8570ac0f-c9e3-4c94-a38a-e40e22a14254 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:47.959240 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-8570ac0f-c9e3-4c94-a38a-e40e22a14254 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:47.959682 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-8570ac0f-c9e3-4c94-a38a-e40e22a14254 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:48.004846 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-9905ce45-8846-47fa-a26b-dd79205aab27 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:48.005304 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-9905ce45-8846-47fa-a26b-dd79205aab27 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:48.005787 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.objects.instance [None req-9905ce45-8846-47fa-a26b-dd79205aab27 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lazy-loading 'fault' on Instance uuid 396d0570-c547-4549-8fe6-dd156ef64c4b {{(pid=118513) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 26 15:01:48.062021 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-9905ce45-8846-47fa-a26b-dd79205aab27 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be4bd5c0f2a400da491bae101b48832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515325707f64d58a28f26451b2c74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:01:48.070397 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-9905ce45-8846-47fa-a26b-dd79205aab27 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /compute/v2.1/servers/396d0570-c547-4549-8fe6-dd156ef64c4b" status: 200 len: 1307 microversion: 2.1 time: 0.150796 May 26 15:01:48.070976 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 401/765] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:01:47 2021] GET /compute/v2.1/servers/396d0570-c547-4549-8fe6-dd156ef64c4b => generated 1307 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:01:48.160669 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-8570ac0f-c9e3-4c94-a38a-e40e22a14254 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c2fb208b56d4d52b59ac09873f16180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e8cac36a174b2eb5a6e53fdf25b4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:01:48.169088 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-8570ac0f-c9e3-4c94-a38a-e40e22a14254 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59" status: 200 len: 1663 microversion: 2.1 time: 0.223377 May 26 15:01:48.169675 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 365/766] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:01:47 2021] GET /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59 => generated 1663 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:01:49.087024 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-936a216e-c766-476a-80b0-405decf8bb32 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:49.087639 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-936a216e-c766-476a-80b0-405decf8bb32 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] [instance: 396d0570-c547-4549-8fe6-dd156ef64c4b] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:01:49.095381 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-936a216e-c766-476a-80b0-405decf8bb32 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:49.095806 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-936a216e-c766-476a-80b0-405decf8bb32 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:49.096587 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-936a216e-c766-476a-80b0-405decf8bb32 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:49.097031 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-936a216e-c766-476a-80b0-405decf8bb32 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:49.186513 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-74923760-db6a-4f33-90e2-36fb9cb18e41 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:49.186972 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-74923760-db6a-4f33-90e2-36fb9cb18e41 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: a9d8f9a6-bd66-4caa-8662-4bb94655ae59] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:01:49.195686 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-74923760-db6a-4f33-90e2-36fb9cb18e41 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:49.196146 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-74923760-db6a-4f33-90e2-36fb9cb18e41 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:49.196951 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-74923760-db6a-4f33-90e2-36fb9cb18e41 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:49.197398 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-74923760-db6a-4f33-90e2-36fb9cb18e41 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:49.313195 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-936a216e-c766-476a-80b0-405decf8bb32 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:49.313442 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-936a216e-c766-476a-80b0-405decf8bb32 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:49.313943 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.objects.instance [None req-936a216e-c766-476a-80b0-405decf8bb32 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lazy-loading 'fault' on Instance uuid 396d0570-c547-4549-8fe6-dd156ef64c4b {{(pid=118513) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 26 15:01:49.370905 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-936a216e-c766-476a-80b0-405decf8bb32 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be4bd5c0f2a400da491bae101b48832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1515325707f64d58a28f26451b2c74de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:01:49.380226 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-936a216e-c766-476a-80b0-405decf8bb32 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /compute/v2.1/servers/396d0570-c547-4549-8fe6-dd156ef64c4b" status: 200 len: 1307 microversion: 2.1 time: 0.296824 May 26 15:01:49.380805 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 402/767] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:01:49 2021] GET /compute/v2.1/servers/396d0570-c547-4549-8fe6-dd156ef64c4b => generated 1307 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:01:49.458633 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-74923760-db6a-4f33-90e2-36fb9cb18e41 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c2fb208b56d4d52b59ac09873f16180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e8cac36a174b2eb5a6e53fdf25b4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:01:49.467280 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-74923760-db6a-4f33-90e2-36fb9cb18e41 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59" status: 200 len: 1663 microversion: 2.1 time: 0.284729 May 26 15:01:49.467852 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 366/768] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:01:49 2021] GET /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59 => generated 1663 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:01:50.397881 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-4c93cf2a-04af-400c-9a46-706eedec48e1 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:50.398517 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-4c93cf2a-04af-400c-9a46-706eedec48e1 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] [instance: 396d0570-c547-4549-8fe6-dd156ef64c4b] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:01:50.408344 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-4c93cf2a-04af-400c-9a46-706eedec48e1 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:50.408344 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-4c93cf2a-04af-400c-9a46-706eedec48e1 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:50.408344 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-4c93cf2a-04af-400c-9a46-706eedec48e1 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:50.408344 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-4c93cf2a-04af-400c-9a46-706eedec48e1 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:50.467103 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.wsgi [None req-4c93cf2a-04af-400c-9a46-706eedec48e1 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] HTTP exception thrown: Instance 396d0570-c547-4549-8fe6-dd156ef64c4b could not be found. May 26 15:01:50.467717 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-4c93cf2a-04af-400c-9a46-706eedec48e1 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] Returning 404 to user: Instance 396d0570-c547-4549-8fe6-dd156ef64c4b could not be found. {{(pid=118513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 26 15:01:50.468608 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-4c93cf2a-04af-400c-9a46-706eedec48e1 tempest-AttachVolumeNegativeTest-1363003837 tempest-AttachVolumeNegativeTest-1363003837-project] 10.222.0.81 "GET /compute/v2.1/servers/396d0570-c547-4549-8fe6-dd156ef64c4b" status: 404 len: 111 microversion: 2.1 time: 0.074317 May 26 15:01:50.470070 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 403/769] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:01:50 2021] GET /compute/v2.1/servers/396d0570-c547-4549-8fe6-dd156ef64c4b => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 15:01:50.483969 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-5c061445-0049-474a-8dd2-27d7dacbceee tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:50.484725 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-5c061445-0049-474a-8dd2-27d7dacbceee tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: a9d8f9a6-bd66-4caa-8662-4bb94655ae59] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:01:50.492295 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-5c061445-0049-474a-8dd2-27d7dacbceee tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:50.492762 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-5c061445-0049-474a-8dd2-27d7dacbceee tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:50.493568 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-5c061445-0049-474a-8dd2-27d7dacbceee tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:50.494020 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-5c061445-0049-474a-8dd2-27d7dacbceee tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:50.645429 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-993baddf-4dce-4980-bcfb-f166ba7a339f tempest-VolumesTestJSON-1649898350 tempest-VolumesTestJSON-1649898350-project] Calling method '.version_select at 0x7f441d9ff430>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:50.737383 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-993baddf-4dce-4980-bcfb-f166ba7a339f tempest-VolumesTestJSON-1649898350 tempest-VolumesTestJSON-1649898350-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/72c63922-abd9-482c-81b4-e652022fd085" status: 200 len: 351 microversion: 2.1 time: 0.095394 May 26 15:01:50.738191 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 404/770] 10.222.0.81 () {58 vars in 1245 bytes} [Wed May 26 15:01:50 2021] GET /compute/v2.1/os-volumes/72c63922-abd9-482c-81b4-e652022fd085 => generated 351 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 15:01:50.900164 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-5c061445-0049-474a-8dd2-27d7dacbceee tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c2fb208b56d4d52b59ac09873f16180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e8cac36a174b2eb5a6e53fdf25b4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:01:50.911215 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-5c061445-0049-474a-8dd2-27d7dacbceee tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59" status: 200 len: 1663 microversion: 2.1 time: 0.430858 May 26 15:01:50.911893 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 367/771] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:01:50 2021] GET /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59 => generated 1663 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:01:51.928794 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-972def0a-a6a7-4b04-ad7b-e435ef67ed66 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:51.929410 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-972def0a-a6a7-4b04-ad7b-e435ef67ed66 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: a9d8f9a6-bd66-4caa-8662-4bb94655ae59] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:01:51.937092 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-972def0a-a6a7-4b04-ad7b-e435ef67ed66 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:51.937610 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-972def0a-a6a7-4b04-ad7b-e435ef67ed66 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:51.938395 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-972def0a-a6a7-4b04-ad7b-e435ef67ed66 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:51.938840 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-972def0a-a6a7-4b04-ad7b-e435ef67ed66 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:52.142212 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-972def0a-a6a7-4b04-ad7b-e435ef67ed66 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c2fb208b56d4d52b59ac09873f16180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e8cac36a174b2eb5a6e53fdf25b4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:01:52.150691 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-972def0a-a6a7-4b04-ad7b-e435ef67ed66 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59" status: 200 len: 1667 microversion: 2.1 time: 0.225694 May 26 15:01:52.151564 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 405/772] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:01:51 2021] GET /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59 => generated 1667 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:01:52.601979 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-f92cfda4-81f2-4181-80f7-be60b51ed9a7 tempest-VolumesTestJSON-1649898350 tempest-VolumesTestJSON-1649898350-project] Calling method '.version_select at 0x7f441e3f5280>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:52.694954 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-f92cfda4-81f2-4181-80f7-be60b51ed9a7 tempest-VolumesTestJSON-1649898350 tempest-VolumesTestJSON-1649898350-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/e77a77d6-33a5-4b36-8e45-7a31d42e62b1" status: 200 len: 351 microversion: 2.1 time: 0.096707 May 26 15:01:52.695534 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 368/773] 10.222.0.81 () {58 vars in 1245 bytes} [Wed May 26 15:01:52 2021] GET /compute/v2.1/os-volumes/e77a77d6-33a5-4b36-8e45-7a31d42e62b1 => generated 351 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:01:52.707046 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-6a0dc46e-d9e1-4861-a771-775b95de209b tempest-VolumesTestJSON-1649898350 tempest-VolumesTestJSON-1649898350-project] Calling method '.version_select at 0x7f441d9ff670>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:52.793410 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-6a0dc46e-d9e1-4861-a771-775b95de209b tempest-VolumesTestJSON-1649898350 tempest-VolumesTestJSON-1649898350-project] 10.222.0.81 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.090463 May 26 15:01:52.794056 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 406/774] 10.222.0.81 () {58 vars in 1134 bytes} [Wed May 26 15:01:52 2021] GET /compute/v2.1/os-volumes => generated 1035 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:01:52.806535 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-84957ba5-a182-45e5-878c-a976874a2588 tempest-VolumesTestJSON-1649898350 tempest-VolumesTestJSON-1649898350-project] Calling method '.version_select at 0x7f441ed41820>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:52.896380 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-84957ba5-a182-45e5-878c-a976874a2588 tempest-VolumesTestJSON-1649898350 tempest-VolumesTestJSON-1649898350-project] 10.222.0.81 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.093519 May 26 15:01:52.897456 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 369/775] 10.222.0.81 () {58 vars in 1149 bytes} [Wed May 26 15:01:52 2021] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:01:52.912588 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-132289a7-3142-47d9-8b46-b413ec0fa6c9 tempest-VolumesTestJSON-1649898350 tempest-VolumesTestJSON-1649898350-project] Calling method '.version_select at 0x7f441d9ffd30>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:53.009430 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-132289a7-3142-47d9-8b46-b413ec0fa6c9 tempest-VolumesTestJSON-1649898350 tempest-VolumesTestJSON-1649898350-project] 10.222.0.81 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.103779 May 26 15:01:53.010106 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 407/776] 10.222.0.81 () {58 vars in 1134 bytes} [Wed May 26 15:01:52 2021] GET /compute/v2.1/os-volumes => generated 1035 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:01:53.022358 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-b8efe82e-c28b-461d-8fa9-42b56d1cb6d1 tempest-VolumesTestJSON-1649898350 tempest-VolumesTestJSON-1649898350-project] Calling method '.version_select at 0x7f441e347940>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:53.118036 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-b8efe82e-c28b-461d-8fa9-42b56d1cb6d1 tempest-VolumesTestJSON-1649898350 tempest-VolumesTestJSON-1649898350-project] 10.222.0.81 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.092096 May 26 15:01:53.118036 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 370/777] 10.222.0.81 () {58 vars in 1167 bytes} [Wed May 26 15:01:53 2021] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:01:53.122824 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-a80c1751-3b28-4697-a49e-7dcf3e018acb tempest-VolumesTestJSON-1649898350 tempest-VolumesTestJSON-1649898350-project] Calling method '.version_select at 0x7f441d951940>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:53.204844 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-a80c1751-3b28-4697-a49e-7dcf3e018acb tempest-VolumesTestJSON-1649898350 tempest-VolumesTestJSON-1649898350-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.085559 May 26 15:01:53.205408 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 408/778] 10.222.0.81 () {58 vars in 1170 bytes} [Wed May 26 15:01:53 2021] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:01:53.222955 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-40ba2e1a-4dcc-4f52-bd5c-a2ce3f71cf7d tempest-VolumesTestJSON-1649898350 tempest-VolumesTestJSON-1649898350-project] Calling method '.version_select at 0x7f441e347ee0>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:53.303263 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-40ba2e1a-4dcc-4f52-bd5c-a2ce3f71cf7d tempest-VolumesTestJSON-1649898350 tempest-VolumesTestJSON-1649898350-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.086123 May 26 15:01:53.303263 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 371/779] 10.222.0.81 () {58 vars in 1155 bytes} [Wed May 26 15:01:53 2021] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:01:53.313851 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-5e6468e9-58f5-4aba-89f1-729e30c6e5cb tempest-VolumesTestJSON-1649898350 tempest-VolumesTestJSON-1649898350-project] Calling method '.version_select at 0x7f441d951e50>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:53.400161 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-5e6468e9-58f5-4aba-89f1-729e30c6e5cb tempest-VolumesTestJSON-1649898350 tempest-VolumesTestJSON-1649898350-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.090128 May 26 15:01:53.400981 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 409/780] 10.222.0.81 () {58 vars in 1188 bytes} [Wed May 26 15:01:53 2021] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:01:53.412802 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-b021ec92-9189-4ff1-bc16-1fd23345f756 tempest-VolumesTestJSON-1649898350 tempest-VolumesTestJSON-1649898350-project] Calling method '.version_select at 0x7f441e4cadc0>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:53.505212 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-b021ec92-9189-4ff1-bc16-1fd23345f756 tempest-VolumesTestJSON-1649898350 tempest-VolumesTestJSON-1649898350-project] 10.222.0.81 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.095732 May 26 15:01:53.505829 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 372/781] 10.222.0.81 () {58 vars in 1155 bytes} [Wed May 26 15:01:53 2021] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:01:54.034053 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-841ade21-5f86-47ff-9718-b66417751bd8 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:54.034053 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-841ade21-5f86-47ff-9718-b66417751bd8 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] [instance: 2d11ba61-751c-43a5-9a56-5638a6afe727] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:01:54.040598 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-841ade21-5f86-47ff-9718-b66417751bd8 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:54.041034 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-841ade21-5f86-47ff-9718-b66417751bd8 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:54.041898 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-841ade21-5f86-47ff-9718-b66417751bd8 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:54.042675 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-841ade21-5f86-47ff-9718-b66417751bd8 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:54.219839 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.objects.instance [None req-841ade21-5f86-47ff-9718-b66417751bd8 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lazy-loading 'services' on Instance uuid 2d11ba61-751c-43a5-9a56-5638a6afe727 {{(pid=118513) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 26 15:01:54.532852 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-841ade21-5f86-47ff-9718-b66417751bd8 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] 10.222.0.81 "DELETE /compute/v2.1/servers/2d11ba61-751c-43a5-9a56-5638a6afe727/os-volume_attachments/64e9dd74-a558-4572-a526-4b810a06affd" status: 202 len: 0 microversion: 2.1 time: 0.504005 May 26 15:01:54.541895 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 410/782] 10.222.0.81 () {58 vars in 1416 bytes} [Wed May 26 15:01:54 2021] DELETE /compute/v2.1/servers/2d11ba61-751c-43a5-9a56-5638a6afe727/os-volume_attachments/64e9dd74-a558-4572-a526-4b810a06affd => generated 0 bytes in 506 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 15:01:55.856260 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-47d6412c-7373-4a5d-a4e0-7b380e300939 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:55.856850 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-47d6412c-7373-4a5d-a4e0-7b380e300939 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] [instance: 2d11ba61-751c-43a5-9a56-5638a6afe727] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:01:55.869035 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-47d6412c-7373-4a5d-a4e0-7b380e300939 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:55.869495 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-47d6412c-7373-4a5d-a4e0-7b380e300939 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:55.870315 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-47d6412c-7373-4a5d-a4e0-7b380e300939 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:55.870762 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-47d6412c-7373-4a5d-a4e0-7b380e300939 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:55.943215 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-47d6412c-7373-4a5d-a4e0-7b380e300939 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] [instance: 2d11ba61-751c-43a5-9a56-5638a6afe727] Going to try to terminate instance {{(pid=118514) delete /opt/stack/nova/nova/compute/api.py:2539}} May 26 15:01:56.270295 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-47d6412c-7373-4a5d-a4e0-7b380e300939 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] 10.222.0.81 "DELETE /compute/v2.1/servers/2d11ba61-751c-43a5-9a56-5638a6afe727" status: 204 len: 0 microversion: 2.1 time: 0.417362 May 26 15:01:56.270895 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 373/783] 10.222.0.81 () {58 vars in 1239 bytes} [Wed May 26 15:01:55 2021] DELETE /compute/v2.1/servers/2d11ba61-751c-43a5-9a56-5638a6afe727 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 15:01:56.279726 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-0cd4c3de-2a18-4cee-8421-976c3c98e5ea tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:56.280523 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-0cd4c3de-2a18-4cee-8421-976c3c98e5ea tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] [instance: 2d11ba61-751c-43a5-9a56-5638a6afe727] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:01:56.288572 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-0cd4c3de-2a18-4cee-8421-976c3c98e5ea tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:56.289032 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-0cd4c3de-2a18-4cee-8421-976c3c98e5ea tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:56.289846 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-0cd4c3de-2a18-4cee-8421-976c3c98e5ea tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:56.290290 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-0cd4c3de-2a18-4cee-8421-976c3c98e5ea tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:56.514502 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-0cd4c3de-2a18-4cee-8421-976c3c98e5ea tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8604f942d44fec96828cc0b1ae5960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b729993a1944061bb0a708877c95a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:01:56.523182 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-0cd4c3de-2a18-4cee-8421-976c3c98e5ea tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] 10.222.0.81 "GET /compute/v2.1/servers/2d11ba61-751c-43a5-9a56-5638a6afe727" status: 200 len: 1514 microversion: 2.1 time: 0.248024 May 26 15:01:56.523841 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 411/784] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:01:56 2021] GET /compute/v2.1/servers/2d11ba61-751c-43a5-9a56-5638a6afe727 => generated 1514 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:01:57.541456 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-d5679936-9119-4784-9c46-f4626de38792 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:57.542255 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-d5679936-9119-4784-9c46-f4626de38792 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] [instance: 2d11ba61-751c-43a5-9a56-5638a6afe727] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:01:57.549447 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-d5679936-9119-4784-9c46-f4626de38792 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:57.551766 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-d5679936-9119-4784-9c46-f4626de38792 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:57.551766 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-d5679936-9119-4784-9c46-f4626de38792 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:57.551766 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-d5679936-9119-4784-9c46-f4626de38792 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:57.747916 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-d5679936-9119-4784-9c46-f4626de38792 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8604f942d44fec96828cc0b1ae5960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b729993a1944061bb0a708877c95a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:01:57.756705 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-d5679936-9119-4784-9c46-f4626de38792 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] 10.222.0.81 "GET /compute/v2.1/servers/2d11ba61-751c-43a5-9a56-5638a6afe727" status: 200 len: 1514 microversion: 2.1 time: 0.219404 May 26 15:01:57.757277 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 374/785] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:01:57 2021] GET /compute/v2.1/servers/2d11ba61-751c-43a5-9a56-5638a6afe727 => generated 1514 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:01:58.773917 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-46c36397-8e4b-4b61-81c9-b963993c996d tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:01:58.774568 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-46c36397-8e4b-4b61-81c9-b963993c996d tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] [instance: 2d11ba61-751c-43a5-9a56-5638a6afe727] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:01:58.782671 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-46c36397-8e4b-4b61-81c9-b963993c996d tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:58.783125 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-46c36397-8e4b-4b61-81c9-b963993c996d tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:58.783896 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-46c36397-8e4b-4b61-81c9-b963993c996d tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:01:58.784340 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-46c36397-8e4b-4b61-81c9-b963993c996d tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:01:58.981441 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-46c36397-8e4b-4b61-81c9-b963993c996d tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8604f942d44fec96828cc0b1ae5960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b729993a1944061bb0a708877c95a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:01:58.990728 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-46c36397-8e4b-4b61-81c9-b963993c996d tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] 10.222.0.81 "GET /compute/v2.1/servers/2d11ba61-751c-43a5-9a56-5638a6afe727" status: 200 len: 1514 microversion: 2.1 time: 0.220375 May 26 15:01:58.991451 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 412/786] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:01:58 2021] GET /compute/v2.1/servers/2d11ba61-751c-43a5-9a56-5638a6afe727 => generated 1514 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:02:00.007317 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-063f3ea2-8027-4956-b686-56c9d1f14cae tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:02:00.007932 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-063f3ea2-8027-4956-b686-56c9d1f14cae tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] [instance: 2d11ba61-751c-43a5-9a56-5638a6afe727] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:02:00.015149 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-063f3ea2-8027-4956-b686-56c9d1f14cae tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:02:00.022022 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-063f3ea2-8027-4956-b686-56c9d1f14cae tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:02:00.022022 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-063f3ea2-8027-4956-b686-56c9d1f14cae tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:02:00.022022 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-063f3ea2-8027-4956-b686-56c9d1f14cae tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:02:00.228898 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-063f3ea2-8027-4956-b686-56c9d1f14cae tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8604f942d44fec96828cc0b1ae5960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b729993a1944061bb0a708877c95a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:02:00.238571 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-063f3ea2-8027-4956-b686-56c9d1f14cae tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] 10.222.0.81 "GET /compute/v2.1/servers/2d11ba61-751c-43a5-9a56-5638a6afe727" status: 200 len: 1514 microversion: 2.1 time: 0.234817 May 26 15:02:00.240419 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 375/787] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:02:00 2021] GET /compute/v2.1/servers/2d11ba61-751c-43a5-9a56-5638a6afe727 => generated 1514 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:02:01.255163 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-7ddb5370-e735-4be4-82de-0f35f9920423 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:02:01.255797 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-7ddb5370-e735-4be4-82de-0f35f9920423 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] [instance: 2d11ba61-751c-43a5-9a56-5638a6afe727] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:02:01.263388 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-7ddb5370-e735-4be4-82de-0f35f9920423 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:02:01.263856 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-7ddb5370-e735-4be4-82de-0f35f9920423 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:02:01.264660 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-7ddb5370-e735-4be4-82de-0f35f9920423 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:02:01.265109 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-7ddb5370-e735-4be4-82de-0f35f9920423 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:02:01.306219 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [req-54b534e8-6233-4a4b-b13a-27a13b2064ed req-804a4355-1916-4ff1-9f17-8e27f776f027 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d11ba61-751c-43a5-9a56-5638a6afe727", "name": "network-vif-deleted", "tag": "5ae9ad7a-f33d-4cca-8a87-1bb5070abea8"}]} {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:02:01.308124 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 15:02:01.308124 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: warnings.warn(msg) May 26 15:02:01.317990 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [req-54b534e8-6233-4a4b-b13a-27a13b2064ed req-804a4355-1916-4ff1-9f17-8e27f776f027 service nova] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:02:01.318835 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [req-54b534e8-6233-4a4b-b13a-27a13b2064ed req-804a4355-1916-4ff1-9f17-8e27f776f027 service nova] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:02:01.345421 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.compute.server_external_events [req-54b534e8-6233-4a4b-b13a-27a13b2064ed req-804a4355-1916-4ff1-9f17-8e27f776f027 service nova] Creating event network-vif-deleted:5ae9ad7a-f33d-4cca-8a87-1bb5070abea8 for instance 2d11ba61-751c-43a5-9a56-5638a6afe727 on hv-cinder-78414 May 26 15:02:01.350929 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [req-54b534e8-6233-4a4b-b13a-27a13b2064ed req-804a4355-1916-4ff1-9f17-8e27f776f027 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048485 May 26 15:02:01.351521 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 376/788] 10.222.0.81 () {64 vars in 1318 bytes} [Wed May 26 15:02:01 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 15:02:01.403636 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-7ddb5370-e735-4be4-82de-0f35f9920423 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8604f942d44fec96828cc0b1ae5960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b729993a1944061bb0a708877c95a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:02:01.413775 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-7ddb5370-e735-4be4-82de-0f35f9920423 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] 10.222.0.81 "GET /compute/v2.1/servers/2d11ba61-751c-43a5-9a56-5638a6afe727" status: 200 len: 1472 microversion: 2.1 time: 0.162112 May 26 15:02:01.414614 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 413/789] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:02:01 2021] GET /compute/v2.1/servers/2d11ba61-751c-43a5-9a56-5638a6afe727 => generated 1472 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:02:02.433900 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-de32dc9e-dcdc-405f-a1bf-527b3e3104b0 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:02:02.434614 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-de32dc9e-dcdc-405f-a1bf-527b3e3104b0 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] [instance: 2d11ba61-751c-43a5-9a56-5638a6afe727] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:02:02.442172 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-de32dc9e-dcdc-405f-a1bf-527b3e3104b0 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:02:02.442629 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-de32dc9e-dcdc-405f-a1bf-527b3e3104b0 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:02:02.443416 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-de32dc9e-dcdc-405f-a1bf-527b3e3104b0 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:02:02.443857 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-de32dc9e-dcdc-405f-a1bf-527b3e3104b0 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:02:02.719263 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-de32dc9e-dcdc-405f-a1bf-527b3e3104b0 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8604f942d44fec96828cc0b1ae5960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b729993a1944061bb0a708877c95a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:02:02.722078 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-de32dc9e-dcdc-405f-a1bf-527b3e3104b0 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] 10.222.0.81 "GET /compute/v2.1/servers/2d11ba61-751c-43a5-9a56-5638a6afe727" status: 200 len: 1472 microversion: 2.1 time: 0.292126 May 26 15:02:02.722667 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 377/790] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:02:02 2021] GET /compute/v2.1/servers/2d11ba61-751c-43a5-9a56-5638a6afe727 => generated 1472 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:02:03.738882 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-92ae2467-83e7-4023-9b20-c696b3d7eeba tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:02:03.739862 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-92ae2467-83e7-4023-9b20-c696b3d7eeba tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] [instance: 2d11ba61-751c-43a5-9a56-5638a6afe727] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:02:03.748273 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-92ae2467-83e7-4023-9b20-c696b3d7eeba tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:02:03.748273 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-92ae2467-83e7-4023-9b20-c696b3d7eeba tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:02:03.748756 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-92ae2467-83e7-4023-9b20-c696b3d7eeba tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:02:03.749206 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-92ae2467-83e7-4023-9b20-c696b3d7eeba tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:02:03.869404 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-92ae2467-83e7-4023-9b20-c696b3d7eeba tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8604f942d44fec96828cc0b1ae5960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b729993a1944061bb0a708877c95a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:02:03.878894 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-92ae2467-83e7-4023-9b20-c696b3d7eeba tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] 10.222.0.81 "GET /compute/v2.1/servers/2d11ba61-751c-43a5-9a56-5638a6afe727" status: 200 len: 1472 microversion: 2.1 time: 0.143350 May 26 15:02:03.878894 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 414/791] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:02:03 2021] GET /compute/v2.1/servers/2d11ba61-751c-43a5-9a56-5638a6afe727 => generated 1472 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:02:04.896158 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-418c7cd3-076a-457c-aa7e-9134fe030603 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:02:04.897339 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-418c7cd3-076a-457c-aa7e-9134fe030603 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] [instance: 2d11ba61-751c-43a5-9a56-5638a6afe727] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:02:04.912120 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-418c7cd3-076a-457c-aa7e-9134fe030603 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:02:04.913744 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-418c7cd3-076a-457c-aa7e-9134fe030603 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:02:04.917222 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-418c7cd3-076a-457c-aa7e-9134fe030603 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:02:04.917222 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-418c7cd3-076a-457c-aa7e-9134fe030603 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:02:04.990609 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-418c7cd3-076a-457c-aa7e-9134fe030603 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:02:04.991233 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-418c7cd3-076a-457c-aa7e-9134fe030603 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:02:04.991849 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.objects.instance [None req-418c7cd3-076a-457c-aa7e-9134fe030603 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lazy-loading 'fault' on Instance uuid 2d11ba61-751c-43a5-9a56-5638a6afe727 {{(pid=118514) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 26 15:02:05.089219 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-418c7cd3-076a-457c-aa7e-9134fe030603 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8604f942d44fec96828cc0b1ae5960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b729993a1944061bb0a708877c95a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:02:05.098226 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-418c7cd3-076a-457c-aa7e-9134fe030603 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] 10.222.0.81 "GET /compute/v2.1/servers/2d11ba61-751c-43a5-9a56-5638a6afe727" status: 200 len: 1309 microversion: 2.1 time: 0.205801 May 26 15:02:05.107683 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 378/792] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:02:04 2021] GET /compute/v2.1/servers/2d11ba61-751c-43a5-9a56-5638a6afe727 => generated 1309 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:02:06.116776 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-6a3eb508-453b-4e55-8ef0-e22c85c1ecb5 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:02:06.117996 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-6a3eb508-453b-4e55-8ef0-e22c85c1ecb5 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] [instance: 2d11ba61-751c-43a5-9a56-5638a6afe727] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:02:06.126052 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-6a3eb508-453b-4e55-8ef0-e22c85c1ecb5 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:02:06.126757 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-6a3eb508-453b-4e55-8ef0-e22c85c1ecb5 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:02:06.127722 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-6a3eb508-453b-4e55-8ef0-e22c85c1ecb5 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:02:06.128167 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-6a3eb508-453b-4e55-8ef0-e22c85c1ecb5 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:02:06.185674 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.wsgi [None req-6a3eb508-453b-4e55-8ef0-e22c85c1ecb5 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] HTTP exception thrown: Instance 2d11ba61-751c-43a5-9a56-5638a6afe727 could not be found. May 26 15:02:06.186289 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-6a3eb508-453b-4e55-8ef0-e22c85c1ecb5 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] Returning 404 to user: Instance 2d11ba61-751c-43a5-9a56-5638a6afe727 could not be found. {{(pid=118513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 26 15:02:06.187778 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-6a3eb508-453b-4e55-8ef0-e22c85c1ecb5 tempest-VolumesSnapshotTestJSON-508043155 tempest-VolumesSnapshotTestJSON-508043155-project] 10.222.0.81 "GET /compute/v2.1/servers/2d11ba61-751c-43a5-9a56-5638a6afe727" status: 404 len: 111 microversion: 2.1 time: 0.075016 May 26 15:02:06.188406 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 415/793] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:02:06 2021] GET /compute/v2.1/servers/2d11ba61-751c-43a5-9a56-5638a6afe727 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 15:02:17.684915 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-8366848d-a5d6-4846-a8e8-4266f1744130 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:02:17.685415 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-8366848d-a5d6-4846-a8e8-4266f1744130 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 598b0e3f-8cf1-451a-80a8-ed7e5dd36984] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:02:17.695166 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-8366848d-a5d6-4846-a8e8-4266f1744130 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:02:17.695721 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-8366848d-a5d6-4846-a8e8-4266f1744130 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:02:17.696622 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-8366848d-a5d6-4846-a8e8-4266f1744130 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:02:17.697088 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-8366848d-a5d6-4846-a8e8-4266f1744130 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:02:17.771724 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-8366848d-a5d6-4846-a8e8-4266f1744130 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984/os-volume_attachments/90c40fb9-fd58-4ae9-aafa-03598f2fb385" status: 200 len: 194 microversion: 2.20 time: 0.090598 May 26 15:02:17.772719 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 379/794] 10.222.0.81 () {60 vars in 1454 bytes} [Wed May 26 15:02:17 2021] GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984/os-volume_attachments/90c40fb9-fd58-4ae9-aafa-03598f2fb385 => generated 194 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 15:02:18.500474 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-5f97d5e5-fa17-4542-b6e1-74090646424e tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:02:18.501615 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-5f97d5e5-fa17-4542-b6e1-74090646424e tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 598b0e3f-8cf1-451a-80a8-ed7e5dd36984] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:02:18.510540 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-5f97d5e5-fa17-4542-b6e1-74090646424e tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:02:18.511265 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-5f97d5e5-fa17-4542-b6e1-74090646424e tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:02:18.512289 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-5f97d5e5-fa17-4542-b6e1-74090646424e tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:02:18.512952 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-5f97d5e5-fa17-4542-b6e1-74090646424e tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:02:18.737282 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.objects.instance [None req-5f97d5e5-fa17-4542-b6e1-74090646424e tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lazy-loading 'services' on Instance uuid 598b0e3f-8cf1-451a-80a8-ed7e5dd36984 {{(pid=118513) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 26 15:02:19.357084 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-5f97d5e5-fa17-4542-b6e1-74090646424e tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "DELETE /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984/os-volume_attachments/90c40fb9-fd58-4ae9-aafa-03598f2fb385" status: 202 len: 0 microversion: 2.20 time: 0.866569 May 26 15:02:19.357974 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 416/795] 10.222.0.81 () {60 vars in 1457 bytes} [Wed May 26 15:02:18 2021] DELETE /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984/os-volume_attachments/90c40fb9-fd58-4ae9-aafa-03598f2fb385 => generated 0 bytes in 868 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 26 15:02:20.808908 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-a006639b-9afc-47c3-95b3-923198b8f42f tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:02:20.809471 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-a006639b-9afc-47c3-95b3-923198b8f42f tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 598b0e3f-8cf1-451a-80a8-ed7e5dd36984] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:02:20.819126 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-a006639b-9afc-47c3-95b3-923198b8f42f tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:02:20.822496 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-a006639b-9afc-47c3-95b3-923198b8f42f tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:02:20.822496 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-a006639b-9afc-47c3-95b3-923198b8f42f tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:02:20.822496 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-a006639b-9afc-47c3-95b3-923198b8f42f tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:02:20.891296 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-a006639b-9afc-47c3-95b3-923198b8f42f tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 598b0e3f-8cf1-451a-80a8-ed7e5dd36984] Going to try to terminate instance {{(pid=118514) delete /opt/stack/nova/nova/compute/api.py:2539}} May 26 15:02:21.347500 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-a006639b-9afc-47c3-95b3-923198b8f42f tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "DELETE /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984" status: 204 len: 0 microversion: 2.20 time: 0.541982 May 26 15:02:21.348790 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 380/796] 10.222.0.81 () {60 vars in 1280 bytes} [Wed May 26 15:02:20 2021] DELETE /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984 => generated 0 bytes in 544 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 26 15:02:21.358192 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-16331156-b9d4-4da4-95ac-dd56d25e4ab4 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:02:21.360234 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-16331156-b9d4-4da4-95ac-dd56d25e4ab4 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 598b0e3f-8cf1-451a-80a8-ed7e5dd36984] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:02:21.369697 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-16331156-b9d4-4da4-95ac-dd56d25e4ab4 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:02:21.370439 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-16331156-b9d4-4da4-95ac-dd56d25e4ab4 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:02:21.371969 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-16331156-b9d4-4da4-95ac-dd56d25e4ab4 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:02:21.372583 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-16331156-b9d4-4da4-95ac-dd56d25e4ab4 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:02:21.612998 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-16331156-b9d4-4da4-95ac-dd56d25e4ab4 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:02:21.623447 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-16331156-b9d4-4da4-95ac-dd56d25e4ab4 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:02:21.626013 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-16331156-b9d4-4da4-95ac-dd56d25e4ab4 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:02:21.627169 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-16331156-b9d4-4da4-95ac-dd56d25e4ab4 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984" status: 200 len: 1722 microversion: 2.20 time: 0.273451 May 26 15:02:21.627729 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 417/797] 10.222.0.81 () {60 vars in 1277 bytes} [Wed May 26 15:02:21 2021] GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984 => generated 1722 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 15:02:22.646810 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-a7e3e142-4e6b-4db9-8952-c57cb91fd8c5 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:02:22.647521 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-a7e3e142-4e6b-4db9-8952-c57cb91fd8c5 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 598b0e3f-8cf1-451a-80a8-ed7e5dd36984] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:02:22.654933 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-a7e3e142-4e6b-4db9-8952-c57cb91fd8c5 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:02:22.655539 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-a7e3e142-4e6b-4db9-8952-c57cb91fd8c5 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:02:22.656940 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-a7e3e142-4e6b-4db9-8952-c57cb91fd8c5 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:02:22.657390 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-a7e3e142-4e6b-4db9-8952-c57cb91fd8c5 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:02:22.866444 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-a7e3e142-4e6b-4db9-8952-c57cb91fd8c5 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:02:22.876848 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-a7e3e142-4e6b-4db9-8952-c57cb91fd8c5 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:02:22.877767 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-a7e3e142-4e6b-4db9-8952-c57cb91fd8c5 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:02:22.878946 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-a7e3e142-4e6b-4db9-8952-c57cb91fd8c5 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984" status: 200 len: 1722 microversion: 2.20 time: 0.236252 May 26 15:02:22.879507 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 381/798] 10.222.0.81 () {60 vars in 1277 bytes} [Wed May 26 15:02:22 2021] GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984 => generated 1722 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:02:23.898400 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-8a268aca-ada6-4a0e-922b-e0c0dec2af92 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:02:23.899051 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-8a268aca-ada6-4a0e-922b-e0c0dec2af92 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 598b0e3f-8cf1-451a-80a8-ed7e5dd36984] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:02:23.907192 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-8a268aca-ada6-4a0e-922b-e0c0dec2af92 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:02:23.907650 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-8a268aca-ada6-4a0e-922b-e0c0dec2af92 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:02:23.908433 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-8a268aca-ada6-4a0e-922b-e0c0dec2af92 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:02:23.908881 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-8a268aca-ada6-4a0e-922b-e0c0dec2af92 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:02:24.119238 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-8a268aca-ada6-4a0e-922b-e0c0dec2af92 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:02:24.127994 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-8a268aca-ada6-4a0e-922b-e0c0dec2af92 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:02:24.129509 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-8a268aca-ada6-4a0e-922b-e0c0dec2af92 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:02:24.130694 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-8a268aca-ada6-4a0e-922b-e0c0dec2af92 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984" status: 200 len: 1722 microversion: 2.20 time: 0.236094 May 26 15:02:24.131250 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 418/799] 10.222.0.81 () {60 vars in 1277 bytes} [Wed May 26 15:02:23 2021] GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984 => generated 1722 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:02:25.150327 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-f26915b2-f18e-4409-94be-b06751a7a0d3 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:02:25.150940 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-f26915b2-f18e-4409-94be-b06751a7a0d3 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 598b0e3f-8cf1-451a-80a8-ed7e5dd36984] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:02:25.158430 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-f26915b2-f18e-4409-94be-b06751a7a0d3 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:02:25.158891 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-f26915b2-f18e-4409-94be-b06751a7a0d3 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:02:25.159829 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-f26915b2-f18e-4409-94be-b06751a7a0d3 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:02:25.160268 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-f26915b2-f18e-4409-94be-b06751a7a0d3 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:02:25.357375 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-f26915b2-f18e-4409-94be-b06751a7a0d3 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:02:25.367404 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-f26915b2-f18e-4409-94be-b06751a7a0d3 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:02:25.369223 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-f26915b2-f18e-4409-94be-b06751a7a0d3 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:02:25.370538 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-f26915b2-f18e-4409-94be-b06751a7a0d3 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984" status: 200 len: 1722 microversion: 2.20 time: 0.224336 May 26 15:02:25.371094 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 382/800] 10.222.0.81 () {60 vars in 1277 bytes} [Wed May 26 15:02:25 2021] GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984 => generated 1722 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:02:26.388361 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-8a2c9203-bcac-4b5d-ba45-131b47305ff5 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:02:26.389108 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-8a2c9203-bcac-4b5d-ba45-131b47305ff5 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 598b0e3f-8cf1-451a-80a8-ed7e5dd36984] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:02:26.397243 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-8a2c9203-bcac-4b5d-ba45-131b47305ff5 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:02:26.397753 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-8a2c9203-bcac-4b5d-ba45-131b47305ff5 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:02:26.398546 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-8a2c9203-bcac-4b5d-ba45-131b47305ff5 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:02:26.399024 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-8a2c9203-bcac-4b5d-ba45-131b47305ff5 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:02:26.536776 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-8a2c9203-bcac-4b5d-ba45-131b47305ff5 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:02:26.550561 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-8a2c9203-bcac-4b5d-ba45-131b47305ff5 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:02:26.553109 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-8a2c9203-bcac-4b5d-ba45-131b47305ff5 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:02:26.554753 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-8a2c9203-bcac-4b5d-ba45-131b47305ff5 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984" status: 200 len: 1654 microversion: 2.20 time: 0.170210 May 26 15:02:26.566379 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 419/801] 10.222.0.81 () {60 vars in 1277 bytes} [Wed May 26 15:02:26 2021] GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984 => generated 1654 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 15:02:26.846647 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [req-1bd5de27-8f16-4aac-aa2c-5c83af781273 req-34f64799-b172-4827-992e-7ad9b4d1ad61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "598b0e3f-8cf1-451a-80a8-ed7e5dd36984", "name": "network-vif-deleted", "tag": "e948d481-711f-45b8-8deb-08b7658709e7"}]} {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:02:26.848415 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 15:02:26.848415 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: warnings.warn(msg) May 26 15:02:26.870564 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [req-1bd5de27-8f16-4aac-aa2c-5c83af781273 req-34f64799-b172-4827-992e-7ad9b4d1ad61 service nova] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:02:26.871280 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [req-1bd5de27-8f16-4aac-aa2c-5c83af781273 req-34f64799-b172-4827-992e-7ad9b4d1ad61 service nova] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:02:26.891892 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.compute.server_external_events [req-1bd5de27-8f16-4aac-aa2c-5c83af781273 req-34f64799-b172-4827-992e-7ad9b4d1ad61 service nova] Creating event network-vif-deleted:e948d481-711f-45b8-8deb-08b7658709e7 for instance 598b0e3f-8cf1-451a-80a8-ed7e5dd36984 on hv-cinder-78414 May 26 15:02:26.897300 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [req-1bd5de27-8f16-4aac-aa2c-5c83af781273 req-34f64799-b172-4827-992e-7ad9b4d1ad61 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057874 May 26 15:02:26.898663 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 383/802] 10.222.0.81 () {64 vars in 1318 bytes} [Wed May 26 15:02:26 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:02:27.575061 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-82fdabd5-b296-47d5-ace4-fe663764d0d0 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:02:27.575585 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-82fdabd5-b296-47d5-ace4-fe663764d0d0 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 598b0e3f-8cf1-451a-80a8-ed7e5dd36984] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:02:27.583620 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-82fdabd5-b296-47d5-ace4-fe663764d0d0 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:02:27.584082 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-82fdabd5-b296-47d5-ace4-fe663764d0d0 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:02:27.585044 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-82fdabd5-b296-47d5-ace4-fe663764d0d0 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:02:27.585702 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-82fdabd5-b296-47d5-ace4-fe663764d0d0 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:02:27.700452 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-82fdabd5-b296-47d5-ace4-fe663764d0d0 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:02:27.700935 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-82fdabd5-b296-47d5-ace4-fe663764d0d0 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:02:27.701363 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.objects.instance [None req-82fdabd5-b296-47d5-ace4-fe663764d0d0 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lazy-loading 'fault' on Instance uuid 598b0e3f-8cf1-451a-80a8-ed7e5dd36984 {{(pid=118513) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 26 15:02:27.896911 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-82fdabd5-b296-47d5-ace4-fe663764d0d0 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:02:27.910027 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-82fdabd5-b296-47d5-ace4-fe663764d0d0 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:02:27.912245 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-82fdabd5-b296-47d5-ace4-fe663764d0d0 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:02:27.913962 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-82fdabd5-b296-47d5-ace4-fe663764d0d0 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984" status: 200 len: 1369 microversion: 2.20 time: 0.342522 May 26 15:02:27.915000 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 420/803] 10.222.0.81 () {60 vars in 1277 bytes} [Wed May 26 15:02:27 2021] GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984 => generated 1369 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:02:28.932846 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-99bd1707-e836-469c-bf9a-5de3e62765fe tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:02:28.933574 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-99bd1707-e836-469c-bf9a-5de3e62765fe tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 598b0e3f-8cf1-451a-80a8-ed7e5dd36984] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:02:28.941330 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-99bd1707-e836-469c-bf9a-5de3e62765fe tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:02:28.942669 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-99bd1707-e836-469c-bf9a-5de3e62765fe tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:02:28.943621 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-99bd1707-e836-469c-bf9a-5de3e62765fe tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:02:28.944073 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-99bd1707-e836-469c-bf9a-5de3e62765fe tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:02:28.997792 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.wsgi [None req-99bd1707-e836-469c-bf9a-5de3e62765fe tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] HTTP exception thrown: Instance 598b0e3f-8cf1-451a-80a8-ed7e5dd36984 could not be found. May 26 15:02:28.998455 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-99bd1707-e836-469c-bf9a-5de3e62765fe tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Returning 404 to user: Instance 598b0e3f-8cf1-451a-80a8-ed7e5dd36984 could not be found. {{(pid=118514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 26 15:02:29.000083 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-99bd1707-e836-469c-bf9a-5de3e62765fe tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984" status: 404 len: 111 microversion: 2.20 time: 0.070656 May 26 15:02:29.000630 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 384/804] 10.222.0.81 () {60 vars in 1277 bytes} [Wed May 26 15:02:28 2021] GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 26 15:02:29.009139 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-460fcf19-8d0f-4668-933a-f6940b4e4c35 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Calling method '.version_select at 0x7f441d9ff040>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:02:29.123047 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-460fcf19-8d0f-4668-933a-f6940b4e4c35 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-67106449" status: 204 len: 0 microversion: 2.20 time: 0.117501 May 26 15:02:29.123670 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 421/805] 10.222.0.81 () {60 vars in 1256 bytes} [Wed May 26 15:02:29 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-67106449 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 26 15:02:30.477256 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-31366878-9845-40a6-acbc-d315af1a965d tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Action: 'create', calling method: .version_select at 0x7f441d890310>, body: {"keypair": {"name": "tempest-keypair-1380492548"}} {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:02:30.501113 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.quota [None req-31366878-9845-40a6-acbc-d315af1a965d tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Getting quotas for project 7555f6895a2a405685d8ccfe81fe5a74. Resources: {'key_pairs'} {{(pid=118514) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 26 15:02:30.505095 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.quota [None req-31366878-9845-40a6-acbc-d315af1a965d tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Getting quotas for user de739c6952a94c308a9cc89c738d8500 and project 7555f6895a2a405685d8ccfe81fe5a74. Resources: {'key_pairs'} {{(pid=118514) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 26 15:02:30.850984 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.quota [None req-31366878-9845-40a6-acbc-d315af1a965d tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Getting quotas for project 7555f6895a2a405685d8ccfe81fe5a74. Resources: {'key_pairs'} {{(pid=118514) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 26 15:02:30.855114 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.quota [None req-31366878-9845-40a6-acbc-d315af1a965d tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Getting quotas for user de739c6952a94c308a9cc89c738d8500 and project 7555f6895a2a405685d8ccfe81fe5a74. Resources: {'key_pairs'} {{(pid=118514) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 26 15:02:30.869044 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-31366878-9845-40a6-acbc-d315af1a965d tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 201 len: 2316 microversion: 2.20 time: 0.395485 May 26 15:02:30.875371 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 385/806] 10.222.0.81 () {62 vars in 1199 bytes} [Wed May 26 15:02:30 2021] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 402 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) May 26 15:02:33.964050 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-658c5c8f-0d7c-4bd8-b21a-5f435ff97119 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-608716287", "imageRef": "dcacad62-e278-4869-aa20-e5df07dd03db", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c010dc4d-023b-4979-a482-d3b3e0924e91"}], "security_groups": [{"name": "tempest-securitygroup--1315006637"}], "key_name": "tempest-keypair-1380492548", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:02:34.374537 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.network.neutron [None req-658c5c8f-0d7c-4bd8-b21a-5f435ff97119 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] validate_networks() for [('c010dc4d-023b-4979-a482-d3b3e0924e91', None, None, None)] {{(pid=118513) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} May 26 15:02:34.908577 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.virt.hardware [None req-658c5c8f-0d7c-4bd8-b21a-5f435ff97119 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Flavor limits 0:0:0 {{(pid=118513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} May 26 15:02:34.909009 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.virt.hardware [None req-658c5c8f-0d7c-4bd8-b21a-5f435ff97119 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Image limits 0:0:0 {{(pid=118513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} May 26 15:02:34.909491 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.virt.hardware [None req-658c5c8f-0d7c-4bd8-b21a-5f435ff97119 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Flavor pref 0:0:0 {{(pid=118513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} May 26 15:02:34.910156 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.virt.hardware [None req-658c5c8f-0d7c-4bd8-b21a-5f435ff97119 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Image pref 0:0:0 {{(pid=118513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} May 26 15:02:34.910336 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.virt.hardware [None req-658c5c8f-0d7c-4bd8-b21a-5f435ff97119 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} May 26 15:02:34.919389 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-658c5c8f-0d7c-4bd8-b21a-5f435ff97119 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:02:34.919849 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-658c5c8f-0d7c-4bd8-b21a-5f435ff97119 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:02:34.920710 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-658c5c8f-0d7c-4bd8-b21a-5f435ff97119 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:02:34.921299 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-658c5c8f-0d7c-4bd8-b21a-5f435ff97119 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:02:34.939162 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.quota [None req-658c5c8f-0d7c-4bd8-b21a-5f435ff97119 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Getting quotas for project 7555f6895a2a405685d8ccfe81fe5a74. Resources: {'instances', 'ram', 'cores'} {{(pid=118513) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 26 15:02:34.943484 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.quota [None req-658c5c8f-0d7c-4bd8-b21a-5f435ff97119 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Getting quotas for user de739c6952a94c308a9cc89c738d8500 and project 7555f6895a2a405685d8ccfe81fe5a74. Resources: {'instances', 'ram', 'cores'} {{(pid=118513) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 26 15:02:34.955534 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-658c5c8f-0d7c-4bd8-b21a-5f435ff97119 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Going to run 1 instances... {{(pid=118513) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 26 15:02:34.957954 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-658c5c8f-0d7c-4bd8-b21a-5f435ff97119 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 757c7def-93df-481f-b40d-7115f4bbbefe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dcacad62-e278-4869-aa20-e5df07dd03db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118513) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} May 26 15:02:35.102860 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-658c5c8f-0d7c-4bd8-b21a-5f435ff97119 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.141796 May 26 15:02:35.102860 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 422/807] 10.222.0.81 () {62 vars in 1188 bytes} [Wed May 26 15:02:33 2021] POST /compute/v2.1/servers => generated 402 bytes in 1143 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) May 26 15:02:35.113680 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-16e4157e-21d3-49f3-b56a-e5a9e2372ff0 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:02:35.114321 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-16e4157e-21d3-49f3-b56a-e5a9e2372ff0 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 757c7def-93df-481f-b40d-7115f4bbbefe] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:02:35.496158 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-16e4157e-21d3-49f3-b56a-e5a9e2372ff0 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:02:35.506173 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-16e4157e-21d3-49f3-b56a-e5a9e2372ff0 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:02:35.507873 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-16e4157e-21d3-49f3-b56a-e5a9e2372ff0 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:02:35.509053 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-16e4157e-21d3-49f3-b56a-e5a9e2372ff0 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe" status: 200 len: 1281 microversion: 2.20 time: 0.400355 May 26 15:02:35.509764 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 386/808] 10.222.0.81 () {60 vars in 1277 bytes} [Wed May 26 15:02:35 2021] GET /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe => generated 1281 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:02:36.528965 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-7fe015c5-b2bb-4f1c-84d7-c6e82f4537dc tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:02:36.529662 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-7fe015c5-b2bb-4f1c-84d7-c6e82f4537dc tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 757c7def-93df-481f-b40d-7115f4bbbefe] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:02:36.545930 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-7fe015c5-b2bb-4f1c-84d7-c6e82f4537dc tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:02:36.546832 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-7fe015c5-b2bb-4f1c-84d7-c6e82f4537dc tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:02:36.547947 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-7fe015c5-b2bb-4f1c-84d7-c6e82f4537dc tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:02:36.548467 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-7fe015c5-b2bb-4f1c-84d7-c6e82f4537dc tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:02:36.724254 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-7fe015c5-b2bb-4f1c-84d7-c6e82f4537dc tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:02:36.735352 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-7fe015c5-b2bb-4f1c-84d7-c6e82f4537dc tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:02:36.737114 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-7fe015c5-b2bb-4f1c-84d7-c6e82f4537dc tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:02:36.739963 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-7fe015c5-b2bb-4f1c-84d7-c6e82f4537dc tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe" status: 200 len: 1277 microversion: 2.20 time: 0.215512 May 26 15:02:36.740655 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 423/809] 10.222.0.81 () {60 vars in 1277 bytes} [Wed May 26 15:02:36 2021] GET /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe => generated 1277 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:02:36.945006 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-e10d2c9b-6815-4c9a-9646-f73ea9254faa tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:02:36.945698 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-e10d2c9b-6815-4c9a-9646-f73ea9254faa tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: a9d8f9a6-bd66-4caa-8662-4bb94655ae59] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:02:36.954297 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-e10d2c9b-6815-4c9a-9646-f73ea9254faa tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:02:36.955022 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-e10d2c9b-6815-4c9a-9646-f73ea9254faa tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:02:36.955874 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-e10d2c9b-6815-4c9a-9646-f73ea9254faa tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:02:36.956380 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-e10d2c9b-6815-4c9a-9646-f73ea9254faa tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:02:37.021979 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-e10d2c9b-6815-4c9a-9646-f73ea9254faa tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: a9d8f9a6-bd66-4caa-8662-4bb94655ae59] Going to try to terminate instance {{(pid=118514) delete /opt/stack/nova/nova/compute/api.py:2539}} May 26 15:02:37.344472 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-e10d2c9b-6815-4c9a-9646-f73ea9254faa tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "DELETE /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59" status: 204 len: 0 microversion: 2.1 time: 0.403679 May 26 15:02:37.345158 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 387/810] 10.222.0.81 () {58 vars in 1239 bytes} [Wed May 26 15:02:36 2021] DELETE /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 15:02:37.353557 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-cefe9431-dfc9-4c84-99d9-450e8d53fb89 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:02:37.354433 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-cefe9431-dfc9-4c84-99d9-450e8d53fb89 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: a9d8f9a6-bd66-4caa-8662-4bb94655ae59] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:02:37.362407 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-cefe9431-dfc9-4c84-99d9-450e8d53fb89 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:02:37.362863 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-cefe9431-dfc9-4c84-99d9-450e8d53fb89 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:02:37.363667 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-cefe9431-dfc9-4c84-99d9-450e8d53fb89 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:02:37.364128 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-cefe9431-dfc9-4c84-99d9-450e8d53fb89 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:02:37.705262 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-cefe9431-dfc9-4c84-99d9-450e8d53fb89 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c2fb208b56d4d52b59ac09873f16180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e8cac36a174b2eb5a6e53fdf25b4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:02:37.713686 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-cefe9431-dfc9-4c84-99d9-450e8d53fb89 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59" status: 200 len: 1673 microversion: 2.1 time: 0.363943 May 26 15:02:37.714262 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 424/811] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:02:37 2021] GET /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59 => generated 1673 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:02:37.760054 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-2f551c60-3a8c-4f2c-a811-7cb77e09bf10 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:02:37.760868 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-2f551c60-3a8c-4f2c-a811-7cb77e09bf10 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 757c7def-93df-481f-b40d-7115f4bbbefe] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:02:37.770403 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-2f551c60-3a8c-4f2c-a811-7cb77e09bf10 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:02:37.770955 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-2f551c60-3a8c-4f2c-a811-7cb77e09bf10 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:02:37.772024 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-2f551c60-3a8c-4f2c-a811-7cb77e09bf10 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:02:37.772596 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-2f551c60-3a8c-4f2c-a811-7cb77e09bf10 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:02:37.918294 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-2f551c60-3a8c-4f2c-a811-7cb77e09bf10 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:02:37.926290 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-2f551c60-3a8c-4f2c-a811-7cb77e09bf10 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:02:37.927817 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-2f551c60-3a8c-4f2c-a811-7cb77e09bf10 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:02:37.928898 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-2f551c60-3a8c-4f2c-a811-7cb77e09bf10 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe" status: 200 len: 1351 microversion: 2.20 time: 0.173228 May 26 15:02:37.929659 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 388/812] 10.222.0.81 () {60 vars in 1277 bytes} [Wed May 26 15:02:37 2021] GET /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe => generated 1351 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 15:02:38.737258 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-81bfc0ef-3142-457e-81e8-e209fdaaf3a5 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:02:38.738800 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-81bfc0ef-3142-457e-81e8-e209fdaaf3a5 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: a9d8f9a6-bd66-4caa-8662-4bb94655ae59] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:02:38.750422 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-81bfc0ef-3142-457e-81e8-e209fdaaf3a5 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:02:38.754310 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-81bfc0ef-3142-457e-81e8-e209fdaaf3a5 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:02:38.755427 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-81bfc0ef-3142-457e-81e8-e209fdaaf3a5 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:02:38.755877 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-81bfc0ef-3142-457e-81e8-e209fdaaf3a5 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:02:38.948107 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-59e5054c-3a12-47f3-8aa3-814cebb3fab2 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:02:38.949701 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-59e5054c-3a12-47f3-8aa3-814cebb3fab2 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 757c7def-93df-481f-b40d-7115f4bbbefe] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:02:38.959831 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-59e5054c-3a12-47f3-8aa3-814cebb3fab2 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:02:38.960794 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-59e5054c-3a12-47f3-8aa3-814cebb3fab2 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:02:38.961817 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-59e5054c-3a12-47f3-8aa3-814cebb3fab2 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:02:38.962449 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-59e5054c-3a12-47f3-8aa3-814cebb3fab2 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:02:39.040683 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-81bfc0ef-3142-457e-81e8-e209fdaaf3a5 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c2fb208b56d4d52b59ac09873f16180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e8cac36a174b2eb5a6e53fdf25b4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:02:39.051047 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-81bfc0ef-3142-457e-81e8-e209fdaaf3a5 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59" status: 200 len: 1673 microversion: 2.1 time: 0.321741 May 26 15:02:39.052020 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 425/813] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:02:38 2021] GET /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59 => generated 1673 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:02:39.254642 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-59e5054c-3a12-47f3-8aa3-814cebb3fab2 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:02:39.263597 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-59e5054c-3a12-47f3-8aa3-814cebb3fab2 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:02:39.265312 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-59e5054c-3a12-47f3-8aa3-814cebb3fab2 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:02:39.266433 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-59e5054c-3a12-47f3-8aa3-814cebb3fab2 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe" status: 200 len: 1407 microversion: 2.20 time: 0.322309 May 26 15:02:39.266994 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 389/814] 10.222.0.81 () {60 vars in 1277 bytes} [Wed May 26 15:02:38 2021] GET /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe => generated 1407 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:02:40.072182 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-9c700e73-acd2-47dd-8e80-6bf8635ebb5c tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:02:40.072925 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-9c700e73-acd2-47dd-8e80-6bf8635ebb5c tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: a9d8f9a6-bd66-4caa-8662-4bb94655ae59] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:02:40.082357 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-9c700e73-acd2-47dd-8e80-6bf8635ebb5c tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:02:40.082934 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-9c700e73-acd2-47dd-8e80-6bf8635ebb5c tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:02:40.083860 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-9c700e73-acd2-47dd-8e80-6bf8635ebb5c tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:02:40.084397 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-9c700e73-acd2-47dd-8e80-6bf8635ebb5c tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:02:40.287491 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-afb921fa-f9c0-4831-b51d-c39f01d3b9f5 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:02:40.288276 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-afb921fa-f9c0-4831-b51d-c39f01d3b9f5 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 757c7def-93df-481f-b40d-7115f4bbbefe] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:02:40.297194 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-afb921fa-f9c0-4831-b51d-c39f01d3b9f5 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:02:40.297838 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-afb921fa-f9c0-4831-b51d-c39f01d3b9f5 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:02:40.298742 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-afb921fa-f9c0-4831-b51d-c39f01d3b9f5 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:02:40.299283 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-afb921fa-f9c0-4831-b51d-c39f01d3b9f5 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:02:40.742437 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-9c700e73-acd2-47dd-8e80-6bf8635ebb5c tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c2fb208b56d4d52b59ac09873f16180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e8cac36a174b2eb5a6e53fdf25b4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:02:40.752743 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-9c700e73-acd2-47dd-8e80-6bf8635ebb5c tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59" status: 200 len: 1673 microversion: 2.1 time: 0.684207 May 26 15:02:40.753737 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 426/815] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:02:40 2021] GET /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59 => generated 1673 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:02:40.797874 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-afb921fa-f9c0-4831-b51d-c39f01d3b9f5 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:02:40.809788 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-afb921fa-f9c0-4831-b51d-c39f01d3b9f5 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:02:40.814307 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-afb921fa-f9c0-4831-b51d-c39f01d3b9f5 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:02:40.816260 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-afb921fa-f9c0-4831-b51d-c39f01d3b9f5 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe" status: 200 len: 1407 microversion: 2.20 time: 0.532490 May 26 15:02:40.818456 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 390/816] 10.222.0.81 () {60 vars in 1277 bytes} [Wed May 26 15:02:40 2021] GET /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe => generated 1407 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:02:41.010986 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [req-9fd11836-ea86-4359-9f3a-ac01710d9096 req-0b440eef-e013-4d1c-b8ee-73bbe5cfbdb5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "757c7def-93df-481f-b40d-7115f4bbbefe", "tag": "d9f82690-b757-4c6f-b288-d20d193f4031"}]} {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:02:41.013355 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 15:02:41.013355 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: warnings.warn(msg) May 26 15:02:41.043282 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [req-9fd11836-ea86-4359-9f3a-ac01710d9096 req-0b440eef-e013-4d1c-b8ee-73bbe5cfbdb5 service nova] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:02:41.044741 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [req-9fd11836-ea86-4359-9f3a-ac01710d9096 req-0b440eef-e013-4d1c-b8ee-73bbe5cfbdb5 service nova] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:02:41.049624 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [req-59962295-fa63-49f0-8792-00292a38b4a8 req-ff2ef4aa-5a67-40e1-8e7c-04b422449082 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9d8f9a6-bd66-4caa-8662-4bb94655ae59", "name": "network-vif-deleted", "tag": "5b77d4a0-1161-49af-829e-9c8b577a215a"}]} {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:02:41.052002 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 15:02:41.052002 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: warnings.warn(msg) May 26 15:02:41.068281 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [req-59962295-fa63-49f0-8792-00292a38b4a8 req-ff2ef4aa-5a67-40e1-8e7c-04b422449082 service nova] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:02:41.068730 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [req-59962295-fa63-49f0-8792-00292a38b4a8 req-ff2ef4aa-5a67-40e1-8e7c-04b422449082 service nova] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:02:41.075089 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.compute.server_external_events [req-9fd11836-ea86-4359-9f3a-ac01710d9096 req-0b440eef-e013-4d1c-b8ee-73bbe5cfbdb5 service nova] Creating event network-changed:d9f82690-b757-4c6f-b288-d20d193f4031 for instance 757c7def-93df-481f-b40d-7115f4bbbefe on hv-cinder-78414 May 26 15:02:41.085232 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [req-9fd11836-ea86-4359-9f3a-ac01710d9096 req-0b440eef-e013-4d1c-b8ee-73bbe5cfbdb5 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079139 May 26 15:02:41.087751 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 427/817] 10.222.0.81 () {64 vars in 1318 bytes} [Wed May 26 15:02:41 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:02:41.109581 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.compute.server_external_events [req-59962295-fa63-49f0-8792-00292a38b4a8 req-ff2ef4aa-5a67-40e1-8e7c-04b422449082 service nova] Creating event network-vif-deleted:5b77d4a0-1161-49af-829e-9c8b577a215a for instance a9d8f9a6-bd66-4caa-8662-4bb94655ae59 on hv-cinder-78414 May 26 15:02:41.116858 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [req-59962295-fa63-49f0-8792-00292a38b4a8 req-ff2ef4aa-5a67-40e1-8e7c-04b422449082 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070996 May 26 15:02:41.118155 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 391/818] 10.222.0.81 () {64 vars in 1318 bytes} [Wed May 26 15:02:41 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 15:02:41.771487 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-b2cbbc42-3ff5-4c79-bcd1-cd6cc6c74139 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:02:41.772428 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-b2cbbc42-3ff5-4c79-bcd1-cd6cc6c74139 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: a9d8f9a6-bd66-4caa-8662-4bb94655ae59] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:02:41.782306 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-b2cbbc42-3ff5-4c79-bcd1-cd6cc6c74139 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:02:41.786428 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-b2cbbc42-3ff5-4c79-bcd1-cd6cc6c74139 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:02:41.786428 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-b2cbbc42-3ff5-4c79-bcd1-cd6cc6c74139 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:02:41.786428 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-b2cbbc42-3ff5-4c79-bcd1-cd6cc6c74139 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:02:41.838865 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-57635357-7565-46a9-b114-99d1b9712c82 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:02:41.839964 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-57635357-7565-46a9-b114-99d1b9712c82 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 757c7def-93df-481f-b40d-7115f4bbbefe] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:02:41.858987 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-57635357-7565-46a9-b114-99d1b9712c82 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:02:41.859538 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-57635357-7565-46a9-b114-99d1b9712c82 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:02:41.861441 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-57635357-7565-46a9-b114-99d1b9712c82 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:02:41.862103 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-57635357-7565-46a9-b114-99d1b9712c82 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:02:41.943826 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-b2cbbc42-3ff5-4c79-bcd1-cd6cc6c74139 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:02:41.947149 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-b2cbbc42-3ff5-4c79-bcd1-cd6cc6c74139 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:02:41.947149 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.objects.instance [None req-b2cbbc42-3ff5-4c79-bcd1-cd6cc6c74139 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lazy-loading 'fault' on Instance uuid a9d8f9a6-bd66-4caa-8662-4bb94655ae59 {{(pid=118513) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 26 15:02:42.156265 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-b2cbbc42-3ff5-4c79-bcd1-cd6cc6c74139 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c2fb208b56d4d52b59ac09873f16180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e8cac36a174b2eb5a6e53fdf25b4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:02:42.175214 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-b2cbbc42-3ff5-4c79-bcd1-cd6cc6c74139 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59" status: 200 len: 1328 microversion: 2.1 time: 0.408092 May 26 15:02:42.175808 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 428/819] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:02:41 2021] GET /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59 => generated 1328 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:02:42.278461 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-57635357-7565-46a9-b114-99d1b9712c82 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:02:42.294274 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-57635357-7565-46a9-b114-99d1b9712c82 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:02:42.296592 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-57635357-7565-46a9-b114-99d1b9712c82 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:02:42.298012 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-57635357-7565-46a9-b114-99d1b9712c82 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe" status: 200 len: 1407 microversion: 2.20 time: 0.464607 May 26 15:02:42.309034 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 392/820] 10.222.0.81 () {60 vars in 1277 bytes} [Wed May 26 15:02:41 2021] GET /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe => generated 1407 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 15:02:43.197335 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-c731bba4-6eb4-441f-904d-b7ad4cebe0a7 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:02:43.198699 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-c731bba4-6eb4-441f-904d-b7ad4cebe0a7 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: a9d8f9a6-bd66-4caa-8662-4bb94655ae59] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:02:43.209164 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-c731bba4-6eb4-441f-904d-b7ad4cebe0a7 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:02:43.210016 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-c731bba4-6eb4-441f-904d-b7ad4cebe0a7 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:02:43.212645 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-c731bba4-6eb4-441f-904d-b7ad4cebe0a7 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:02:43.213316 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-c731bba4-6eb4-441f-904d-b7ad4cebe0a7 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:02:43.275720 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.wsgi [None req-c731bba4-6eb4-441f-904d-b7ad4cebe0a7 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] HTTP exception thrown: Instance a9d8f9a6-bd66-4caa-8662-4bb94655ae59 could not be found. May 26 15:02:43.276540 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-c731bba4-6eb4-441f-904d-b7ad4cebe0a7 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Returning 404 to user: Instance a9d8f9a6-bd66-4caa-8662-4bb94655ae59 could not be found. {{(pid=118513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 26 15:02:43.278309 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-c731bba4-6eb4-441f-904d-b7ad4cebe0a7 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59" status: 404 len: 111 microversion: 2.1 time: 0.085377 May 26 15:02:43.278979 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 429/821] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:02:43 2021] GET /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 15:02:43.289190 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-d12a57ab-cad7-4b4b-9ef7-dcf7b7214329 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Calling method '.version_select at 0x7f441ed41820>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:02:43.316957 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-28be4033-a32a-4819-b816-8e3f6dccd1a4 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:02:43.317616 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-28be4033-a32a-4819-b816-8e3f6dccd1a4 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 757c7def-93df-481f-b40d-7115f4bbbefe] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:02:43.325210 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-28be4033-a32a-4819-b816-8e3f6dccd1a4 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:02:43.327651 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-28be4033-a32a-4819-b816-8e3f6dccd1a4 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:02:43.328567 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-28be4033-a32a-4819-b816-8e3f6dccd1a4 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:02:43.329014 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-28be4033-a32a-4819-b816-8e3f6dccd1a4 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:02:43.386101 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-d12a57ab-cad7-4b4b-9ef7-dcf7b7214329 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1526408858" status: 202 len: 0 microversion: 2.1 time: 0.101252 May 26 15:02:43.386771 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 393/822] 10.222.0.81 () {58 vars in 1221 bytes} [Wed May 26 15:02:43 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1526408858 => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 15:02:43.864011 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-28be4033-a32a-4819-b816-8e3f6dccd1a4 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:02:43.873093 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-28be4033-a32a-4819-b816-8e3f6dccd1a4 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:02:43.875656 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-28be4033-a32a-4819-b816-8e3f6dccd1a4 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:02:43.877017 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-28be4033-a32a-4819-b816-8e3f6dccd1a4 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe" status: 200 len: 1407 microversion: 2.20 time: 0.564022 May 26 15:02:43.878030 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 430/823] 10.222.0.81 () {60 vars in 1277 bytes} [Wed May 26 15:02:43 2021] GET /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe => generated 1407 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 15:02:44.899116 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-bec47736-01d5-47af-909c-4156db07c441 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:02:44.900614 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-bec47736-01d5-47af-909c-4156db07c441 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 757c7def-93df-481f-b40d-7115f4bbbefe] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:02:44.913696 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-bec47736-01d5-47af-909c-4156db07c441 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:02:44.914826 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-bec47736-01d5-47af-909c-4156db07c441 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:02:44.915554 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-bec47736-01d5-47af-909c-4156db07c441 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:02:44.915554 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-bec47736-01d5-47af-909c-4156db07c441 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:02:44.928078 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-6bf56f61-1e3c-401d-9837-45e92b293418 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Action: 'create', calling method: .version_select at 0x7f441d9ff550>, body: {"keypair": {"name": "tempest-keypair-808154170"}} {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:02:44.970841 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.quota [None req-6bf56f61-1e3c-401d-9837-45e92b293418 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Getting quotas for project 81e8cac36a174b2eb5a6e53fdf25b4cc. Resources: {'key_pairs'} {{(pid=118513) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 26 15:02:44.972698 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.quota [None req-6bf56f61-1e3c-401d-9837-45e92b293418 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Getting quotas for user 8c2fb208b56d4d52b59ac09873f16180 and project 81e8cac36a174b2eb5a6e53fdf25b4cc. Resources: {'key_pairs'} {{(pid=118513) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 26 15:02:45.397506 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-bec47736-01d5-47af-909c-4156db07c441 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:02:45.412831 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-bec47736-01d5-47af-909c-4156db07c441 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:02:45.415210 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-bec47736-01d5-47af-909c-4156db07c441 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:02:45.417797 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-bec47736-01d5-47af-909c-4156db07c441 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe" status: 200 len: 1407 microversion: 2.20 time: 0.524747 May 26 15:02:45.419392 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 394/824] 10.222.0.81 () {60 vars in 1277 bytes} [Wed May 26 15:02:44 2021] GET /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe => generated 1407 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:02:45.596252 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.quota [None req-6bf56f61-1e3c-401d-9837-45e92b293418 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Getting quotas for project 81e8cac36a174b2eb5a6e53fdf25b4cc. Resources: {'key_pairs'} {{(pid=118513) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 26 15:02:45.600975 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.quota [None req-6bf56f61-1e3c-401d-9837-45e92b293418 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Getting quotas for user 8c2fb208b56d4d52b59ac09873f16180 and project 81e8cac36a174b2eb5a6e53fdf25b4cc. Resources: {'key_pairs'} {{(pid=118513) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 26 15:02:45.615434 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-6bf56f61-1e3c-401d-9837-45e92b293418 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 0.690527 May 26 15:02:45.615868 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 431/825] 10.222.0.81 () {60 vars in 1158 bytes} [Wed May 26 15:02:44 2021] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:02:46.437261 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-b1f1e21a-7dbc-4429-ac54-eaf90ecccb7a tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:02:46.437879 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-b1f1e21a-7dbc-4429-ac54-eaf90ecccb7a tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 757c7def-93df-481f-b40d-7115f4bbbefe] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:02:46.445859 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-b1f1e21a-7dbc-4429-ac54-eaf90ecccb7a tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:02:46.446501 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-b1f1e21a-7dbc-4429-ac54-eaf90ecccb7a tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:02:46.447298 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-b1f1e21a-7dbc-4429-ac54-eaf90ecccb7a tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:02:46.447735 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-b1f1e21a-7dbc-4429-ac54-eaf90ecccb7a tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:02:46.661449 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-b1f1e21a-7dbc-4429-ac54-eaf90ecccb7a tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:02:46.673148 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-b1f1e21a-7dbc-4429-ac54-eaf90ecccb7a tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:02:46.675616 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-b1f1e21a-7dbc-4429-ac54-eaf90ecccb7a tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:02:46.677867 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-b1f1e21a-7dbc-4429-ac54-eaf90ecccb7a tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe" status: 200 len: 1407 microversion: 2.20 time: 0.245340 May 26 15:02:46.678842 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 395/826] 10.222.0.81 () {60 vars in 1277 bytes} [Wed May 26 15:02:46 2021] GET /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe => generated 1407 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:02:47.697599 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-ab97f986-00dd-4a98-83fc-55e6d47beb75 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:02:47.699552 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-ab97f986-00dd-4a98-83fc-55e6d47beb75 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 757c7def-93df-481f-b40d-7115f4bbbefe] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:02:47.709365 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-ab97f986-00dd-4a98-83fc-55e6d47beb75 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:02:47.709937 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-ab97f986-00dd-4a98-83fc-55e6d47beb75 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:02:47.710811 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-ab97f986-00dd-4a98-83fc-55e6d47beb75 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:02:47.711327 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-ab97f986-00dd-4a98-83fc-55e6d47beb75 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:02:48.153254 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-ab97f986-00dd-4a98-83fc-55e6d47beb75 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:02:48.172489 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-ab97f986-00dd-4a98-83fc-55e6d47beb75 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:02:48.174074 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-ab97f986-00dd-4a98-83fc-55e6d47beb75 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:02:48.175275 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-ab97f986-00dd-4a98-83fc-55e6d47beb75 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe" status: 200 len: 1407 microversion: 2.20 time: 0.482849 May 26 15:02:48.176256 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 432/827] 10.222.0.81 () {60 vars in 1277 bytes} [Wed May 26 15:02:47 2021] GET /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe => generated 1407 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:02:49.199738 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-95cd5201-8f9e-42a7-b79a-45ac5fffa1e3 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:02:49.202455 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-95cd5201-8f9e-42a7-b79a-45ac5fffa1e3 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 757c7def-93df-481f-b40d-7115f4bbbefe] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:02:49.232074 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-95cd5201-8f9e-42a7-b79a-45ac5fffa1e3 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:02:49.232533 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-95cd5201-8f9e-42a7-b79a-45ac5fffa1e3 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:02:49.235037 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-95cd5201-8f9e-42a7-b79a-45ac5fffa1e3 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:02:49.237945 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-95cd5201-8f9e-42a7-b79a-45ac5fffa1e3 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:02:49.422857 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-496aabeb-881e-4afb-83e2-f597af2afcf9 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-869237473", "imageRef": "dcacad62-e278-4869-aa20-e5df07dd03db", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9a6b2b45-d448-425b-9716-75ffabad6539"}], "security_groups": [{"name": "tempest-securitygroup--1771820736"}], "key_name": "tempest-keypair-808154170", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:02:49.610485 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-95cd5201-8f9e-42a7-b79a-45ac5fffa1e3 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:02:49.622363 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-95cd5201-8f9e-42a7-b79a-45ac5fffa1e3 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:02:49.624932 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-95cd5201-8f9e-42a7-b79a-45ac5fffa1e3 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:02:49.625780 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-95cd5201-8f9e-42a7-b79a-45ac5fffa1e3 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe" status: 200 len: 1407 microversion: 2.20 time: 0.434879 May 26 15:02:49.637760 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 396/828] 10.222.0.81 () {60 vars in 1277 bytes} [Wed May 26 15:02:49 2021] GET /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe => generated 1407 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:02:49.832055 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.network.neutron [None req-496aabeb-881e-4afb-83e2-f597af2afcf9 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] validate_networks() for [('9a6b2b45-d448-425b-9716-75ffabad6539', None, None, None)] {{(pid=118513) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} May 26 15:02:50.643648 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.virt.hardware [None req-496aabeb-881e-4afb-83e2-f597af2afcf9 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Flavor limits 0:0:0 {{(pid=118513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} May 26 15:02:50.644674 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-ca482ea3-a5c9-48fb-bc87-4253bc6c5a1e tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:02:50.645414 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-ca482ea3-a5c9-48fb-bc87-4253bc6c5a1e tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 757c7def-93df-481f-b40d-7115f4bbbefe] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:02:50.645713 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.virt.hardware [None req-496aabeb-881e-4afb-83e2-f597af2afcf9 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Image limits 0:0:0 {{(pid=118513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} May 26 15:02:50.653335 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.virt.hardware [None req-496aabeb-881e-4afb-83e2-f597af2afcf9 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Flavor pref 0:0:0 {{(pid=118513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} May 26 15:02:50.653505 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-ca482ea3-a5c9-48fb-bc87-4253bc6c5a1e tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:02:50.653892 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-ca482ea3-a5c9-48fb-bc87-4253bc6c5a1e tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:02:50.654463 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.virt.hardware [None req-496aabeb-881e-4afb-83e2-f597af2afcf9 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Image pref 0:0:0 {{(pid=118513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} May 26 15:02:50.655290 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-ca482ea3-a5c9-48fb-bc87-4253bc6c5a1e tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:02:50.655994 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-ca482ea3-a5c9-48fb-bc87-4253bc6c5a1e tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:02:50.656900 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.virt.hardware [None req-496aabeb-881e-4afb-83e2-f597af2afcf9 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} May 26 15:02:50.680619 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-496aabeb-881e-4afb-83e2-f597af2afcf9 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:02:50.681353 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-496aabeb-881e-4afb-83e2-f597af2afcf9 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:02:50.682848 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-496aabeb-881e-4afb-83e2-f597af2afcf9 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:02:50.685076 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-496aabeb-881e-4afb-83e2-f597af2afcf9 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:02:50.732695 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.quota [None req-496aabeb-881e-4afb-83e2-f597af2afcf9 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Getting quotas for project 81e8cac36a174b2eb5a6e53fdf25b4cc. Resources: {'instances', 'ram', 'cores'} {{(pid=118513) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 26 15:02:50.747993 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.quota [None req-496aabeb-881e-4afb-83e2-f597af2afcf9 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Getting quotas for user 8c2fb208b56d4d52b59ac09873f16180 and project 81e8cac36a174b2eb5a6e53fdf25b4cc. Resources: {'instances', 'ram', 'cores'} {{(pid=118513) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 26 15:02:50.759951 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-496aabeb-881e-4afb-83e2-f597af2afcf9 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Going to run 1 instances... {{(pid=118513) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 26 15:02:50.762549 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-496aabeb-881e-4afb-83e2-f597af2afcf9 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: 7ad07221-7c50-403d-9d99-8f876d7b7c63] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dcacad62-e278-4869-aa20-e5df07dd03db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118513) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} May 26 15:02:50.897057 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-496aabeb-881e-4afb-83e2-f597af2afcf9 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.702156 May 26 15:02:50.898873 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 433/829] 10.222.0.81 () {60 vars in 1147 bytes} [Wed May 26 15:02:49 2021] POST /compute/v2.1/servers => generated 402 bytes in 1705 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 26 15:02:50.910793 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [req-391de538-6eea-4d98-8b08-3ec36e7c39c1 req-01029ba5-4f29-4eab-8571-765d289334ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "757c7def-93df-481f-b40d-7115f4bbbefe", "name": "network-vif-plugged", "status": "completed", "tag": "d9f82690-b757-4c6f-b288-d20d193f4031"}]} {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:02:50.912552 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 15:02:50.912552 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: warnings.warn(msg) May 26 15:02:50.946840 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [req-391de538-6eea-4d98-8b08-3ec36e7c39c1 req-01029ba5-4f29-4eab-8571-765d289334ed service nova] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:02:50.948537 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [req-391de538-6eea-4d98-8b08-3ec36e7c39c1 req-01029ba5-4f29-4eab-8571-765d289334ed service nova] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:02:50.973092 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.compute.server_external_events [req-391de538-6eea-4d98-8b08-3ec36e7c39c1 req-01029ba5-4f29-4eab-8571-765d289334ed service nova] Creating event network-vif-plugged:d9f82690-b757-4c6f-b288-d20d193f4031 for instance 757c7def-93df-481f-b40d-7115f4bbbefe on hv-cinder-78414 May 26 15:02:50.987243 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-ca482ea3-a5c9-48fb-bc87-4253bc6c5a1e tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:02:50.994976 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [req-391de538-6eea-4d98-8b08-3ec36e7c39c1 req-01029ba5-4f29-4eab-8571-765d289334ed service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074634 May 26 15:02:50.997070 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 434/830] 10.222.0.81 () {64 vars in 1318 bytes} [Wed May 26 15:02:50 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:02:51.022169 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-ead24682-109f-4525-b2c4-7ea99aff36cb tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:02:51.023827 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-ca482ea3-a5c9-48fb-bc87-4253bc6c5a1e tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:02:51.027160 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-ca482ea3-a5c9-48fb-bc87-4253bc6c5a1e tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:02:51.033118 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-ca482ea3-a5c9-48fb-bc87-4253bc6c5a1e tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe" status: 200 len: 1407 microversion: 2.20 time: 0.392452 May 26 15:02:51.034924 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 397/831] 10.222.0.81 () {60 vars in 1277 bytes} [Wed May 26 15:02:50 2021] GET /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe => generated 1407 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 15:02:51.036392 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-ead24682-109f-4525-b2c4-7ea99aff36cb tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: 7ad07221-7c50-403d-9d99-8f876d7b7c63] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:02:51.198870 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-ead24682-109f-4525-b2c4-7ea99aff36cb tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c2fb208b56d4d52b59ac09873f16180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e8cac36a174b2eb5a6e53fdf25b4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:02:51.215224 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-ead24682-109f-4525-b2c4-7ea99aff36cb tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /compute/v2.1/servers/7ad07221-7c50-403d-9d99-8f876d7b7c63" status: 200 len: 1236 microversion: 2.1 time: 0.210942 May 26 15:02:51.216511 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 435/832] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:02:50 2021] GET /compute/v2.1/servers/7ad07221-7c50-403d-9d99-8f876d7b7c63 => generated 1236 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:02:52.051096 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-a75b28c4-965d-4261-84c9-cbf3f23ecf7e tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:02:52.051858 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-a75b28c4-965d-4261-84c9-cbf3f23ecf7e tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 757c7def-93df-481f-b40d-7115f4bbbefe] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:02:52.059770 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-a75b28c4-965d-4261-84c9-cbf3f23ecf7e tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:02:52.060272 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-a75b28c4-965d-4261-84c9-cbf3f23ecf7e tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:02:52.061222 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-a75b28c4-965d-4261-84c9-cbf3f23ecf7e tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:02:52.062043 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-a75b28c4-965d-4261-84c9-cbf3f23ecf7e tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:02:52.234797 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-9f7d629a-4776-4ea2-afba-6eb813f5d6ff tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:02:52.236170 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-9f7d629a-4776-4ea2-afba-6eb813f5d6ff tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: 7ad07221-7c50-403d-9d99-8f876d7b7c63] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:02:52.337457 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-9f7d629a-4776-4ea2-afba-6eb813f5d6ff tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c2fb208b56d4d52b59ac09873f16180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e8cac36a174b2eb5a6e53fdf25b4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:02:52.346352 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-9f7d629a-4776-4ea2-afba-6eb813f5d6ff tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /compute/v2.1/servers/7ad07221-7c50-403d-9d99-8f876d7b7c63" status: 200 len: 1236 microversion: 2.1 time: 0.117353 May 26 15:02:52.356365 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 436/833] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:02:52 2021] GET /compute/v2.1/servers/7ad07221-7c50-403d-9d99-8f876d7b7c63 => generated 1236 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:02:52.472926 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-a75b28c4-965d-4261-84c9-cbf3f23ecf7e tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:02:52.481732 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-a75b28c4-965d-4261-84c9-cbf3f23ecf7e tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:02:52.485020 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-a75b28c4-965d-4261-84c9-cbf3f23ecf7e tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:02:52.486152 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-a75b28c4-965d-4261-84c9-cbf3f23ecf7e tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe" status: 200 len: 1407 microversion: 2.20 time: 0.438859 May 26 15:02:52.488072 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 398/834] 10.222.0.81 () {60 vars in 1277 bytes} [Wed May 26 15:02:52 2021] GET /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe => generated 1407 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:02:53.364338 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-490d665b-341a-410d-b51d-347827d6a78e tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:02:53.365058 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-490d665b-341a-410d-b51d-347827d6a78e tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: 7ad07221-7c50-403d-9d99-8f876d7b7c63] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:02:53.387517 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-490d665b-341a-410d-b51d-347827d6a78e tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:02:53.388015 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-490d665b-341a-410d-b51d-347827d6a78e tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:02:53.389481 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-490d665b-341a-410d-b51d-347827d6a78e tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:02:53.389982 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-490d665b-341a-410d-b51d-347827d6a78e tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:02:53.505912 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-c7eb7095-0265-409e-ad76-9bd72acddf54 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:02:53.507429 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-c7eb7095-0265-409e-ad76-9bd72acddf54 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 757c7def-93df-481f-b40d-7115f4bbbefe] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:02:53.516808 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-c7eb7095-0265-409e-ad76-9bd72acddf54 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:02:53.517267 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-c7eb7095-0265-409e-ad76-9bd72acddf54 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:02:53.518091 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-c7eb7095-0265-409e-ad76-9bd72acddf54 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:02:53.530449 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-c7eb7095-0265-409e-ad76-9bd72acddf54 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:02:53.605839 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-490d665b-341a-410d-b51d-347827d6a78e tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c2fb208b56d4d52b59ac09873f16180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e8cac36a174b2eb5a6e53fdf25b4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:02:53.619564 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-490d665b-341a-410d-b51d-347827d6a78e tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /compute/v2.1/servers/7ad07221-7c50-403d-9d99-8f876d7b7c63" status: 200 len: 1288 microversion: 2.1 time: 0.259315 May 26 15:02:53.622406 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 437/835] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:02:53 2021] GET /compute/v2.1/servers/7ad07221-7c50-403d-9d99-8f876d7b7c63 => generated 1288 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:02:53.990622 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-c7eb7095-0265-409e-ad76-9bd72acddf54 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:02:54.008417 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-c7eb7095-0265-409e-ad76-9bd72acddf54 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:02:54.011497 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-c7eb7095-0265-409e-ad76-9bd72acddf54 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:02:54.012680 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-c7eb7095-0265-409e-ad76-9bd72acddf54 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe" status: 200 len: 1599 microversion: 2.20 time: 0.511154 May 26 15:02:54.013243 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 399/836] 10.222.0.81 () {60 vars in 1277 bytes} [Wed May 26 15:02:53 2021] GET /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe => generated 1599 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 15:02:54.034421 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-b41fbef1-7cc2-4087-b452-511a66cd28c7 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:02:54.035300 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-b41fbef1-7cc2-4087-b452-511a66cd28c7 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 757c7def-93df-481f-b40d-7115f4bbbefe] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:02:54.053284 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-b41fbef1-7cc2-4087-b452-511a66cd28c7 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:02:54.053780 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-b41fbef1-7cc2-4087-b452-511a66cd28c7 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:02:54.054586 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-b41fbef1-7cc2-4087-b452-511a66cd28c7 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:02:54.055033 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-b41fbef1-7cc2-4087-b452-511a66cd28c7 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:02:54.424517 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-b41fbef1-7cc2-4087-b452-511a66cd28c7 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.393869 May 26 15:02:54.425469 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 438/837] 10.222.0.81 () {60 vars in 1316 bytes} [Wed May 26 15:02:54 2021] GET /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe/os-interface => generated 284 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 15:02:54.638107 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-b1967336-296f-428f-bb0d-a381507d012a tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:02:54.639872 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-b1967336-296f-428f-bb0d-a381507d012a tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: 7ad07221-7c50-403d-9d99-8f876d7b7c63] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:02:54.653991 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-b1967336-296f-428f-bb0d-a381507d012a tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:02:54.654470 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-b1967336-296f-428f-bb0d-a381507d012a tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:02:54.655267 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-b1967336-296f-428f-bb0d-a381507d012a tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:02:54.655705 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-b1967336-296f-428f-bb0d-a381507d012a tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:02:55.017107 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-b1967336-296f-428f-bb0d-a381507d012a tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c2fb208b56d4d52b59ac09873f16180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e8cac36a174b2eb5a6e53fdf25b4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:02:55.026159 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-b1967336-296f-428f-bb0d-a381507d012a tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /compute/v2.1/servers/7ad07221-7c50-403d-9d99-8f876d7b7c63" status: 200 len: 1294 microversion: 2.1 time: 0.392558 May 26 15:02:55.028073 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 400/838] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:02:54 2021] GET /compute/v2.1/servers/7ad07221-7c50-403d-9d99-8f876d7b7c63 => generated 1294 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:02:56.048119 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-a3f9da7d-6a71-44fd-ab43-0a1480183e34 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:02:56.048119 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-a3f9da7d-6a71-44fd-ab43-0a1480183e34 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: 7ad07221-7c50-403d-9d99-8f876d7b7c63] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:02:56.056289 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-a3f9da7d-6a71-44fd-ab43-0a1480183e34 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:02:56.057100 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-a3f9da7d-6a71-44fd-ab43-0a1480183e34 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:02:56.058103 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-a3f9da7d-6a71-44fd-ab43-0a1480183e34 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:02:56.058709 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-a3f9da7d-6a71-44fd-ab43-0a1480183e34 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:02:57.049088 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-a3f9da7d-6a71-44fd-ab43-0a1480183e34 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c2fb208b56d4d52b59ac09873f16180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e8cac36a174b2eb5a6e53fdf25b4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:02:57.065306 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-a3f9da7d-6a71-44fd-ab43-0a1480183e34 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /compute/v2.1/servers/7ad07221-7c50-403d-9d99-8f876d7b7c63" status: 200 len: 1362 microversion: 2.1 time: 1.024476 May 26 15:02:57.070059 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 439/839] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:02:56 2021] GET /compute/v2.1/servers/7ad07221-7c50-403d-9d99-8f876d7b7c63 => generated 1362 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:02:57.863717 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [req-d185d441-b8a7-4eb7-93eb-4d78f96bb5fd req-ed96cbe5-13b8-4636-9a1b-bad3869ae9b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "757c7def-93df-481f-b40d-7115f4bbbefe", "tag": "d9f82690-b757-4c6f-b288-d20d193f4031"}]} {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:02:57.865475 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 15:02:57.865475 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: warnings.warn(msg) May 26 15:02:57.879960 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [req-d185d441-b8a7-4eb7-93eb-4d78f96bb5fd req-ed96cbe5-13b8-4636-9a1b-bad3869ae9b0 service nova] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:02:57.880433 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [req-d185d441-b8a7-4eb7-93eb-4d78f96bb5fd req-ed96cbe5-13b8-4636-9a1b-bad3869ae9b0 service nova] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:02:57.906048 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-736db3d5-e9c0-4fce-b3dd-fc32e8eea7f9 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:02:57.907060 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-736db3d5-e9c0-4fce-b3dd-fc32e8eea7f9 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 757c7def-93df-481f-b40d-7115f4bbbefe] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:02:57.921179 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-736db3d5-e9c0-4fce-b3dd-fc32e8eea7f9 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:02:57.925774 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-736db3d5-e9c0-4fce-b3dd-fc32e8eea7f9 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:02:57.926708 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-736db3d5-e9c0-4fce-b3dd-fc32e8eea7f9 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:02:57.927167 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-736db3d5-e9c0-4fce-b3dd-fc32e8eea7f9 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:02:57.935261 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.compute.server_external_events [req-d185d441-b8a7-4eb7-93eb-4d78f96bb5fd req-ed96cbe5-13b8-4636-9a1b-bad3869ae9b0 service nova] Creating event network-changed:d9f82690-b757-4c6f-b288-d20d193f4031 for instance 757c7def-93df-481f-b40d-7115f4bbbefe on hv-cinder-78414 May 26 15:02:57.958606 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [req-d185d441-b8a7-4eb7-93eb-4d78f96bb5fd req-ed96cbe5-13b8-4636-9a1b-bad3869ae9b0 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.406692 May 26 15:02:57.959864 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 440/840] 10.222.0.81 () {64 vars in 1318 bytes} [Wed May 26 15:02:57 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:02:58.080909 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-736db3d5-e9c0-4fce-b3dd-fc32e8eea7f9 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "POST /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe/action" status: 200 len: 14 microversion: 2.20 time: 0.539463 May 26 15:02:58.082000 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 401/841] 10.222.0.81 () {62 vars in 1319 bytes} [Wed May 26 15:02:57 2021] POST /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe/action => generated 14 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:02:58.085046 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-08f8f178-62d6-4276-863f-f1d935a16cef tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:02:58.085905 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-08f8f178-62d6-4276-863f-f1d935a16cef tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: 7ad07221-7c50-403d-9d99-8f876d7b7c63] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:02:58.111542 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-08f8f178-62d6-4276-863f-f1d935a16cef tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:02:58.112461 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-08f8f178-62d6-4276-863f-f1d935a16cef tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:02:58.116152 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-08f8f178-62d6-4276-863f-f1d935a16cef tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:02:58.116963 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-08f8f178-62d6-4276-863f-f1d935a16cef tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:02:58.612236 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-08f8f178-62d6-4276-863f-f1d935a16cef tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c2fb208b56d4d52b59ac09873f16180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e8cac36a174b2eb5a6e53fdf25b4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:02:58.629313 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-08f8f178-62d6-4276-863f-f1d935a16cef tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /compute/v2.1/servers/7ad07221-7c50-403d-9d99-8f876d7b7c63" status: 200 len: 1362 microversion: 2.1 time: 0.548522 May 26 15:02:58.629991 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 441/842] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:02:58 2021] GET /compute/v2.1/servers/7ad07221-7c50-403d-9d99-8f876d7b7c63 => generated 1362 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:02:59.093481 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-a6ce993f-31c7-4f88-8fac-31a6d73b0b33 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:02:59.095230 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-a6ce993f-31c7-4f88-8fac-31a6d73b0b33 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 757c7def-93df-481f-b40d-7115f4bbbefe] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:02:59.118336 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-a6ce993f-31c7-4f88-8fac-31a6d73b0b33 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:02:59.119128 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-a6ce993f-31c7-4f88-8fac-31a6d73b0b33 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:02:59.120163 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-a6ce993f-31c7-4f88-8fac-31a6d73b0b33 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:02:59.120793 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-a6ce993f-31c7-4f88-8fac-31a6d73b0b33 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:02:59.283177 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-a6ce993f-31c7-4f88-8fac-31a6d73b0b33 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "POST /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe/action" status: 200 len: 14 microversion: 2.20 time: 0.194443 May 26 15:02:59.284828 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 402/843] 10.222.0.81 () {62 vars in 1319 bytes} [Wed May 26 15:02:59 2021] POST /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe/action => generated 14 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:02:59.646811 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-4b10373e-0202-4adc-b3ef-221c0561da06 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:02:59.648035 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-4b10373e-0202-4adc-b3ef-221c0561da06 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: 7ad07221-7c50-403d-9d99-8f876d7b7c63] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:02:59.666650 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-4b10373e-0202-4adc-b3ef-221c0561da06 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:02:59.667409 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-4b10373e-0202-4adc-b3ef-221c0561da06 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:02:59.668429 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-4b10373e-0202-4adc-b3ef-221c0561da06 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:02:59.669042 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-4b10373e-0202-4adc-b3ef-221c0561da06 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:02:59.774720 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 15:02:59.775185 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: Wed May 26 15:02:59 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 15:03:00.100956 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-4b10373e-0202-4adc-b3ef-221c0561da06 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c2fb208b56d4d52b59ac09873f16180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e8cac36a174b2eb5a6e53fdf25b4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:03:00.114506 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-4b10373e-0202-4adc-b3ef-221c0561da06 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /compute/v2.1/servers/7ad07221-7c50-403d-9d99-8f876d7b7c63" status: 200 len: 1362 microversion: 2.1 time: 0.472533 May 26 15:03:00.124987 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 442/844] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:02:59 2021] GET /compute/v2.1/servers/7ad07221-7c50-403d-9d99-8f876d7b7c63 => generated 1362 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:03:00.251895 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [req-54f67a02-fb88-492d-969d-6974d4c7e64f req-bc4d4e4e-bc0e-4cf8-9dec-2baf541c4668 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ad07221-7c50-403d-9d99-8f876d7b7c63", "tag": "5bd02faf-9eb5-4f97-86fd-6985a1bd6902"}]} {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:03:00.253326 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 15:03:00.253326 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: warnings.warn(msg) May 26 15:03:00.263224 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [req-54f67a02-fb88-492d-969d-6974d4c7e64f req-bc4d4e4e-bc0e-4cf8-9dec-2baf541c4668 service nova] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:00.264241 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [req-54f67a02-fb88-492d-969d-6974d4c7e64f req-bc4d4e4e-bc0e-4cf8-9dec-2baf541c4668 service nova] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:00.282363 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.compute.server_external_events [req-54f67a02-fb88-492d-969d-6974d4c7e64f req-bc4d4e4e-bc0e-4cf8-9dec-2baf541c4668 service nova] Creating event network-changed:5bd02faf-9eb5-4f97-86fd-6985a1bd6902 for instance 7ad07221-7c50-403d-9d99-8f876d7b7c63 on hv-cinder-78414 May 26 15:03:00.287502 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [req-54f67a02-fb88-492d-969d-6974d4c7e64f req-bc4d4e4e-bc0e-4cf8-9dec-2baf541c4668 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040008 May 26 15:03:00.288388 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 403/845] 10.222.0.81 () {64 vars in 1318 bytes} [Wed May 26 15:03:00 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 15:03:00.296176 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-ae51998b-8cf8-453d-a8e8-1e617d75d1e9 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:03:00.303866 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-ae51998b-8cf8-453d-a8e8-1e617d75d1e9 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 757c7def-93df-481f-b40d-7115f4bbbefe] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:03:00.313035 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-ae51998b-8cf8-453d-a8e8-1e617d75d1e9 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:00.319846 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-ae51998b-8cf8-453d-a8e8-1e617d75d1e9 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:00.319846 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-ae51998b-8cf8-453d-a8e8-1e617d75d1e9 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:00.319846 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-ae51998b-8cf8-453d-a8e8-1e617d75d1e9 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:00.440994 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-ae51998b-8cf8-453d-a8e8-1e617d75d1e9 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "POST /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe/action" status: 200 len: 14 microversion: 2.20 time: 0.149869 May 26 15:03:00.442528 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 443/846] 10.222.0.81 () {62 vars in 1319 bytes} [Wed May 26 15:03:00 2021] POST /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe/action => generated 14 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:03:01.131924 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-859811e7-16d5-4f03-894e-d2d76c3b56de tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:03:01.133043 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-859811e7-16d5-4f03-894e-d2d76c3b56de tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: 7ad07221-7c50-403d-9d99-8f876d7b7c63] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:03:01.142881 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-859811e7-16d5-4f03-894e-d2d76c3b56de tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:01.143686 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-859811e7-16d5-4f03-894e-d2d76c3b56de tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:01.144899 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-859811e7-16d5-4f03-894e-d2d76c3b56de tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:01.145841 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-859811e7-16d5-4f03-894e-d2d76c3b56de tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:01.453488 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-c8157183-dfdd-4089-9b2a-fe2eb9775036 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:03:01.455236 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-c8157183-dfdd-4089-9b2a-fe2eb9775036 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 757c7def-93df-481f-b40d-7115f4bbbefe] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:03:01.471547 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-c8157183-dfdd-4089-9b2a-fe2eb9775036 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:01.472351 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-c8157183-dfdd-4089-9b2a-fe2eb9775036 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:01.474271 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-c8157183-dfdd-4089-9b2a-fe2eb9775036 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:01.474732 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-c8157183-dfdd-4089-9b2a-fe2eb9775036 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:01.593945 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-c8157183-dfdd-4089-9b2a-fe2eb9775036 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "POST /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe/action" status: 200 len: 14 microversion: 2.20 time: 0.146018 May 26 15:03:01.594665 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 444/847] 10.222.0.81 () {62 vars in 1319 bytes} [Wed May 26 15:03:01 2021] POST /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe/action => generated 14 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:03:01.789081 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-859811e7-16d5-4f03-894e-d2d76c3b56de tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c2fb208b56d4d52b59ac09873f16180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e8cac36a174b2eb5a6e53fdf25b4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:03:01.797622 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-859811e7-16d5-4f03-894e-d2d76c3b56de tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /compute/v2.1/servers/7ad07221-7c50-403d-9d99-8f876d7b7c63" status: 200 len: 1362 microversion: 2.1 time: 0.669787 May 26 15:03:01.798485 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 404/848] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:03:01 2021] GET /compute/v2.1/servers/7ad07221-7c50-403d-9d99-8f876d7b7c63 => generated 1362 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:03:02.605008 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-48e3fae9-00d5-46c4-807c-808b42dde26a tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:03:02.606134 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-48e3fae9-00d5-46c4-807c-808b42dde26a tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 757c7def-93df-481f-b40d-7115f4bbbefe] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:03:02.614541 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-48e3fae9-00d5-46c4-807c-808b42dde26a tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:02.615255 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-48e3fae9-00d5-46c4-807c-808b42dde26a tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:02.616244 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-48e3fae9-00d5-46c4-807c-808b42dde26a tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:02.616890 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-48e3fae9-00d5-46c4-807c-808b42dde26a tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:02.713833 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-48e3fae9-00d5-46c4-807c-808b42dde26a tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "POST /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe/action" status: 200 len: 14 microversion: 2.20 time: 0.111616 May 26 15:03:02.715099 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 445/849] 10.222.0.81 () {62 vars in 1319 bytes} [Wed May 26 15:03:02 2021] POST /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe/action => generated 14 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:03:02.815101 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-0374ad7d-b896-42c4-bfde-fb61668dda28 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:03:02.816389 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-0374ad7d-b896-42c4-bfde-fb61668dda28 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: 7ad07221-7c50-403d-9d99-8f876d7b7c63] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:03:02.826205 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-0374ad7d-b896-42c4-bfde-fb61668dda28 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:02.827576 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-0374ad7d-b896-42c4-bfde-fb61668dda28 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:02.828143 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-0374ad7d-b896-42c4-bfde-fb61668dda28 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:02.828682 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-0374ad7d-b896-42c4-bfde-fb61668dda28 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:03.111108 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-0374ad7d-b896-42c4-bfde-fb61668dda28 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c2fb208b56d4d52b59ac09873f16180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e8cac36a174b2eb5a6e53fdf25b4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:03:03.128320 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-0374ad7d-b896-42c4-bfde-fb61668dda28 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /compute/v2.1/servers/7ad07221-7c50-403d-9d99-8f876d7b7c63" status: 200 len: 1362 microversion: 2.1 time: 0.317259 May 26 15:03:03.132001 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 405/850] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:03:02 2021] GET /compute/v2.1/servers/7ad07221-7c50-403d-9d99-8f876d7b7c63 => generated 1362 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:03:03.738083 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-39de0637-36be-4f31-81af-e05334172175 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:03:03.739867 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-39de0637-36be-4f31-81af-e05334172175 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 757c7def-93df-481f-b40d-7115f4bbbefe] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:03:03.751870 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-39de0637-36be-4f31-81af-e05334172175 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:03.759552 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-39de0637-36be-4f31-81af-e05334172175 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:03.760887 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-39de0637-36be-4f31-81af-e05334172175 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:03.761404 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-39de0637-36be-4f31-81af-e05334172175 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:03.905491 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-39de0637-36be-4f31-81af-e05334172175 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "POST /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe/action" status: 200 len: 14 microversion: 2.20 time: 0.178894 May 26 15:03:03.909190 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 446/851] 10.222.0.81 () {62 vars in 1319 bytes} [Wed May 26 15:03:03 2021] POST /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe/action => generated 14 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:03:04.148127 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-a53922f1-0aca-43c1-9780-08aadd891bf6 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:03:04.149664 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-a53922f1-0aca-43c1-9780-08aadd891bf6 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: 7ad07221-7c50-403d-9d99-8f876d7b7c63] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:03:04.158190 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-a53922f1-0aca-43c1-9780-08aadd891bf6 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:04.159015 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-a53922f1-0aca-43c1-9780-08aadd891bf6 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:04.160043 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-a53922f1-0aca-43c1-9780-08aadd891bf6 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:04.160610 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-a53922f1-0aca-43c1-9780-08aadd891bf6 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:04.424899 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-a53922f1-0aca-43c1-9780-08aadd891bf6 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c2fb208b56d4d52b59ac09873f16180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e8cac36a174b2eb5a6e53fdf25b4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:03:04.434277 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-a53922f1-0aca-43c1-9780-08aadd891bf6 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /compute/v2.1/servers/7ad07221-7c50-403d-9d99-8f876d7b7c63" status: 200 len: 1362 microversion: 2.1 time: 0.289754 May 26 15:03:04.435158 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 406/852] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:03:04 2021] GET /compute/v2.1/servers/7ad07221-7c50-403d-9d99-8f876d7b7c63 => generated 1362 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:03:04.918079 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-76efdb72-4f91-4921-8af4-6bc24d2922de tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:03:04.920555 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-76efdb72-4f91-4921-8af4-6bc24d2922de tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 757c7def-93df-481f-b40d-7115f4bbbefe] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:03:04.933499 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-76efdb72-4f91-4921-8af4-6bc24d2922de tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:04.934578 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-76efdb72-4f91-4921-8af4-6bc24d2922de tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:04.936882 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-76efdb72-4f91-4921-8af4-6bc24d2922de tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:04.937615 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-76efdb72-4f91-4921-8af4-6bc24d2922de tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:05.008831 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [req-2be16898-3c78-450f-a095-c72c2554b9c1 req-2741673c-496b-4350-a239-eeb8eceb5db2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ad07221-7c50-403d-9d99-8f876d7b7c63", "name": "network-vif-plugged", "status": "completed", "tag": "5bd02faf-9eb5-4f97-86fd-6985a1bd6902"}]} {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:03:05.010711 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 15:03:05.010711 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: warnings.warn(msg) May 26 15:03:05.023358 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [req-2be16898-3c78-450f-a095-c72c2554b9c1 req-2741673c-496b-4350-a239-eeb8eceb5db2 service nova] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:05.024328 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [req-2be16898-3c78-450f-a095-c72c2554b9c1 req-2741673c-496b-4350-a239-eeb8eceb5db2 service nova] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:05.046086 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.compute.server_external_events [req-2be16898-3c78-450f-a095-c72c2554b9c1 req-2741673c-496b-4350-a239-eeb8eceb5db2 service nova] Creating event network-vif-plugged:5bd02faf-9eb5-4f97-86fd-6985a1bd6902 for instance 7ad07221-7c50-403d-9d99-8f876d7b7c63 on hv-cinder-78414 May 26 15:03:05.054527 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-76efdb72-4f91-4921-8af4-6bc24d2922de tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "POST /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe/action" status: 200 len: 14 microversion: 2.20 time: 0.138878 May 26 15:03:05.054656 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [req-2be16898-3c78-450f-a095-c72c2554b9c1 req-2741673c-496b-4350-a239-eeb8eceb5db2 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049206 May 26 15:03:05.067833 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 407/854] 10.222.0.81 () {64 vars in 1318 bytes} [Wed May 26 15:03:05 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 15:03:05.067928 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 447/854] 10.222.0.81 () {62 vars in 1319 bytes} [Wed May 26 15:03:04 2021] POST /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe/action => generated 14 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:03:05.462000 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-5a996b0a-e746-40ef-80ea-779b922e84d0 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:03:05.463286 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-5a996b0a-e746-40ef-80ea-779b922e84d0 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: 7ad07221-7c50-403d-9d99-8f876d7b7c63] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:03:05.475265 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-5a996b0a-e746-40ef-80ea-779b922e84d0 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:05.475983 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-5a996b0a-e746-40ef-80ea-779b922e84d0 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:05.476934 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-5a996b0a-e746-40ef-80ea-779b922e84d0 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:05.477556 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-5a996b0a-e746-40ef-80ea-779b922e84d0 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:05.866260 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-5a996b0a-e746-40ef-80ea-779b922e84d0 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c2fb208b56d4d52b59ac09873f16180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e8cac36a174b2eb5a6e53fdf25b4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:03:05.876889 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-5a996b0a-e746-40ef-80ea-779b922e84d0 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /compute/v2.1/servers/7ad07221-7c50-403d-9d99-8f876d7b7c63" status: 200 len: 1362 microversion: 2.1 time: 0.427995 May 26 15:03:05.879892 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 408/855] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:03:05 2021] GET /compute/v2.1/servers/7ad07221-7c50-403d-9d99-8f876d7b7c63 => generated 1362 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:03:06.067598 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-bdbcaaef-bf44-444d-82fb-410ac68c5b26 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:03:06.068788 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-bdbcaaef-bf44-444d-82fb-410ac68c5b26 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 757c7def-93df-481f-b40d-7115f4bbbefe] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:03:06.077128 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-bdbcaaef-bf44-444d-82fb-410ac68c5b26 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:06.077707 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-bdbcaaef-bf44-444d-82fb-410ac68c5b26 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:06.080989 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-bdbcaaef-bf44-444d-82fb-410ac68c5b26 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:06.081762 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-bdbcaaef-bf44-444d-82fb-410ac68c5b26 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:06.187259 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-bdbcaaef-bf44-444d-82fb-410ac68c5b26 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "POST /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe/action" status: 200 len: 11050 microversion: 2.20 time: 0.123664 May 26 15:03:06.187906 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 448/856] 10.222.0.81 () {62 vars in 1319 bytes} [Wed May 26 15:03:06 2021] POST /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe/action => generated 11050 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 26 15:03:06.897513 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-3e4af03a-998f-4e44-a265-9604261f1df5 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:03:06.898880 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-3e4af03a-998f-4e44-a265-9604261f1df5 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: 7ad07221-7c50-403d-9d99-8f876d7b7c63] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:03:06.908485 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-3e4af03a-998f-4e44-a265-9604261f1df5 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:06.909014 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-3e4af03a-998f-4e44-a265-9604261f1df5 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:06.910100 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-3e4af03a-998f-4e44-a265-9604261f1df5 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:06.911451 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-3e4af03a-998f-4e44-a265-9604261f1df5 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:07.159998 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-3e4af03a-998f-4e44-a265-9604261f1df5 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c2fb208b56d4d52b59ac09873f16180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e8cac36a174b2eb5a6e53fdf25b4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:03:07.168947 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-3e4af03a-998f-4e44-a265-9604261f1df5 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /compute/v2.1/servers/7ad07221-7c50-403d-9d99-8f876d7b7c63" status: 200 len: 1548 microversion: 2.1 time: 0.275280 May 26 15:03:07.187545 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-2160705b-01a9-455d-a135-ad31d2d35cca tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:03:07.188748 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-2160705b-01a9-455d-a135-ad31d2d35cca tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: 7ad07221-7c50-403d-9d99-8f876d7b7c63] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:03:07.191284 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 409/857] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:03:06 2021] GET /compute/v2.1/servers/7ad07221-7c50-403d-9d99-8f876d7b7c63 => generated 1548 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:03:07.201361 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-d34b6be9-b337-4845-a799-1b0944056084 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:03:07.208376 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-2160705b-01a9-455d-a135-ad31d2d35cca tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:07.208519 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-d34b6be9-b337-4845-a799-1b0944056084 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 757c7def-93df-481f-b40d-7115f4bbbefe] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:03:07.208618 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-2160705b-01a9-455d-a135-ad31d2d35cca tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:07.209284 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-2160705b-01a9-455d-a135-ad31d2d35cca tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:07.209856 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-2160705b-01a9-455d-a135-ad31d2d35cca tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:07.226216 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-d34b6be9-b337-4845-a799-1b0944056084 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:07.227307 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-d34b6be9-b337-4845-a799-1b0944056084 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:07.228266 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-d34b6be9-b337-4845-a799-1b0944056084 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:07.228867 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-d34b6be9-b337-4845-a799-1b0944056084 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:07.334861 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-d34b6be9-b337-4845-a799-1b0944056084 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "POST /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe/action" status: 200 len: 16319 microversion: 2.20 time: 0.140608 May 26 15:03:07.335943 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 410/858] 10.222.0.81 () {62 vars in 1319 bytes} [Wed May 26 15:03:07 2021] POST /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe/action => generated 16319 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 26 15:03:07.367365 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-2160705b-01a9-455d-a135-ad31d2d35cca tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /compute/v2.1/servers/7ad07221-7c50-403d-9d99-8f876d7b7c63/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.184590 May 26 15:03:07.374523 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 449/859] 10.222.0.81 () {58 vars in 1275 bytes} [Wed May 26 15:03:07 2021] GET /compute/v2.1/servers/7ad07221-7c50-403d-9d99-8f876d7b7c63/os-interface => generated 285 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:03:08.350869 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-d926e435-540c-4052-99ec-307642fcb63b tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:03:08.351943 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-d926e435-540c-4052-99ec-307642fcb63b tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 757c7def-93df-481f-b40d-7115f4bbbefe] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:03:08.361397 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-d926e435-540c-4052-99ec-307642fcb63b tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:08.362166 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-d926e435-540c-4052-99ec-307642fcb63b tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:08.363504 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-d926e435-540c-4052-99ec-307642fcb63b tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:08.364200 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-d926e435-540c-4052-99ec-307642fcb63b tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:08.473577 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-d926e435-540c-4052-99ec-307642fcb63b tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "POST /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe/action" status: 200 len: 18356 microversion: 2.20 time: 0.129578 May 26 15:03:08.474231 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 411/860] 10.222.0.81 () {62 vars in 1319 bytes} [Wed May 26 15:03:08 2021] POST /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe/action => generated 18356 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 26 15:03:09.357715 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-20bac3bf-3218-412a-84f5-b3bcae2cef20 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:03:09.358844 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-20bac3bf-3218-412a-84f5-b3bcae2cef20 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: 7ad07221-7c50-403d-9d99-8f876d7b7c63] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:03:09.370099 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-20bac3bf-3218-412a-84f5-b3bcae2cef20 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:09.370832 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-20bac3bf-3218-412a-84f5-b3bcae2cef20 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:09.371846 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-20bac3bf-3218-412a-84f5-b3bcae2cef20 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:09.372461 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-20bac3bf-3218-412a-84f5-b3bcae2cef20 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:09.374648 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [req-9c791e1c-9eb7-4216-bc15-be391c17c74d req-dcc6dc07-fe8b-4075-8a40-e3cc19a2b78e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ad07221-7c50-403d-9d99-8f876d7b7c63", "tag": "5bd02faf-9eb5-4f97-86fd-6985a1bd6902"}]} {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:03:09.384746 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 15:03:09.384746 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: warnings.warn(msg) May 26 15:03:09.395728 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [req-9c791e1c-9eb7-4216-bc15-be391c17c74d req-dcc6dc07-fe8b-4075-8a40-e3cc19a2b78e service nova] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:09.396350 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [req-9c791e1c-9eb7-4216-bc15-be391c17c74d req-dcc6dc07-fe8b-4075-8a40-e3cc19a2b78e service nova] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:09.416380 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.compute.server_external_events [req-9c791e1c-9eb7-4216-bc15-be391c17c74d req-dcc6dc07-fe8b-4075-8a40-e3cc19a2b78e service nova] Creating event network-changed:5bd02faf-9eb5-4f97-86fd-6985a1bd6902 for instance 7ad07221-7c50-403d-9d99-8f876d7b7c63 on hv-cinder-78414 May 26 15:03:09.422042 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [req-9c791e1c-9eb7-4216-bc15-be391c17c74d req-dcc6dc07-fe8b-4075-8a40-e3cc19a2b78e service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052596 May 26 15:03:09.422900 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 412/861] 10.222.0.81 () {64 vars in 1318 bytes} [Wed May 26 15:03:09 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 15:03:09.485050 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-20bac3bf-3218-412a-84f5-b3bcae2cef20 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "POST /compute/v2.1/servers/7ad07221-7c50-403d-9d99-8f876d7b7c63/action" status: 200 len: 14 microversion: 2.1 time: 0.131316 May 26 15:03:09.491268 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 450/862] 10.222.0.81 () {60 vars in 1278 bytes} [Wed May 26 15:03:09 2021] POST /compute/v2.1/servers/7ad07221-7c50-403d-9d99-8f876d7b7c63/action => generated 14 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 26 15:03:09.494499 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-66c6f176-2574-40fc-a428-6bf951cb38e9 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:03:09.496983 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-66c6f176-2574-40fc-a428-6bf951cb38e9 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 757c7def-93df-481f-b40d-7115f4bbbefe] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:03:09.508053 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-66c6f176-2574-40fc-a428-6bf951cb38e9 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:09.508894 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-66c6f176-2574-40fc-a428-6bf951cb38e9 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:09.509889 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-66c6f176-2574-40fc-a428-6bf951cb38e9 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:09.510654 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-66c6f176-2574-40fc-a428-6bf951cb38e9 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:09.652827 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-66c6f176-2574-40fc-a428-6bf951cb38e9 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "POST /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe/action" status: 200 len: 19342 microversion: 2.20 time: 0.156032 May 26 15:03:09.652827 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 413/863] 10.222.0.81 () {62 vars in 1319 bytes} [Wed May 26 15:03:09 2021] POST /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe/action => generated 19342 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 26 15:03:10.502667 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-d40eee91-e6ca-4c8a-82dd-6e812277cc45 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:03:10.504299 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-d40eee91-e6ca-4c8a-82dd-6e812277cc45 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: 7ad07221-7c50-403d-9d99-8f876d7b7c63] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:03:10.512995 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-d40eee91-e6ca-4c8a-82dd-6e812277cc45 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:10.513900 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-d40eee91-e6ca-4c8a-82dd-6e812277cc45 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:10.527922 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-d40eee91-e6ca-4c8a-82dd-6e812277cc45 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:10.527922 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-d40eee91-e6ca-4c8a-82dd-6e812277cc45 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:10.617235 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-d40eee91-e6ca-4c8a-82dd-6e812277cc45 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "POST /compute/v2.1/servers/7ad07221-7c50-403d-9d99-8f876d7b7c63/action" status: 200 len: 14 microversion: 2.1 time: 0.122375 May 26 15:03:10.618129 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 451/864] 10.222.0.81 () {60 vars in 1278 bytes} [Wed May 26 15:03:10 2021] POST /compute/v2.1/servers/7ad07221-7c50-403d-9d99-8f876d7b7c63/action => generated 14 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 26 15:03:10.661251 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-213e5c41-966a-4785-9dbb-f67cecec7c9d tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:03:10.663000 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-213e5c41-966a-4785-9dbb-f67cecec7c9d tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 757c7def-93df-481f-b40d-7115f4bbbefe] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:03:10.671641 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-213e5c41-966a-4785-9dbb-f67cecec7c9d tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:10.672478 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-213e5c41-966a-4785-9dbb-f67cecec7c9d tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:10.673351 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-213e5c41-966a-4785-9dbb-f67cecec7c9d tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:10.674020 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-213e5c41-966a-4785-9dbb-f67cecec7c9d tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:10.785328 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-213e5c41-966a-4785-9dbb-f67cecec7c9d tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "POST /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe/action" status: 200 len: 21929 microversion: 2.20 time: 0.127825 May 26 15:03:10.786162 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 414/865] 10.222.0.81 () {62 vars in 1319 bytes} [Wed May 26 15:03:10 2021] POST /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe/action => generated 21929 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 26 15:03:11.629084 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-19c79bb0-5d69-440a-901a-db0280d59ed4 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:03:11.630110 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-19c79bb0-5d69-440a-901a-db0280d59ed4 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: 7ad07221-7c50-403d-9d99-8f876d7b7c63] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:03:11.637987 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-19c79bb0-5d69-440a-901a-db0280d59ed4 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:11.639170 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-19c79bb0-5d69-440a-901a-db0280d59ed4 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:11.639956 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-19c79bb0-5d69-440a-901a-db0280d59ed4 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:11.640390 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-19c79bb0-5d69-440a-901a-db0280d59ed4 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:11.769145 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-19c79bb0-5d69-440a-901a-db0280d59ed4 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "POST /compute/v2.1/servers/7ad07221-7c50-403d-9d99-8f876d7b7c63/action" status: 200 len: 14 microversion: 2.1 time: 0.143115 May 26 15:03:11.772203 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 452/866] 10.222.0.81 () {60 vars in 1278 bytes} [Wed May 26 15:03:11 2021] POST /compute/v2.1/servers/7ad07221-7c50-403d-9d99-8f876d7b7c63/action => generated 14 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 26 15:03:11.799991 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-ec397110-e0da-4c59-9733-6cde67ae1aaa tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:03:11.801766 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-ec397110-e0da-4c59-9733-6cde67ae1aaa tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 757c7def-93df-481f-b40d-7115f4bbbefe] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:03:11.810503 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-ec397110-e0da-4c59-9733-6cde67ae1aaa tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:11.811190 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-ec397110-e0da-4c59-9733-6cde67ae1aaa tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:11.812081 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-ec397110-e0da-4c59-9733-6cde67ae1aaa tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:11.812635 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-ec397110-e0da-4c59-9733-6cde67ae1aaa tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:11.916959 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-ec397110-e0da-4c59-9733-6cde67ae1aaa tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "POST /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe/action" status: 200 len: 23198 microversion: 2.20 time: 0.123694 May 26 15:03:11.921585 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 415/867] 10.222.0.81 () {62 vars in 1319 bytes} [Wed May 26 15:03:11 2021] POST /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe/action => generated 23198 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 26 15:03:12.781428 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-ac286e7e-38ae-46f9-baa8-38aaa4daa2da tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:03:12.783138 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-ac286e7e-38ae-46f9-baa8-38aaa4daa2da tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: 7ad07221-7c50-403d-9d99-8f876d7b7c63] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:03:12.791914 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-ac286e7e-38ae-46f9-baa8-38aaa4daa2da tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:12.792724 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-ac286e7e-38ae-46f9-baa8-38aaa4daa2da tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:12.794292 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-ac286e7e-38ae-46f9-baa8-38aaa4daa2da tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:12.795977 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-ac286e7e-38ae-46f9-baa8-38aaa4daa2da tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:12.892240 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-ac286e7e-38ae-46f9-baa8-38aaa4daa2da tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "POST /compute/v2.1/servers/7ad07221-7c50-403d-9d99-8f876d7b7c63/action" status: 200 len: 14 microversion: 2.1 time: 0.115277 May 26 15:03:12.893265 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 453/868] 10.222.0.81 () {60 vars in 1278 bytes} [Wed May 26 15:03:12 2021] POST /compute/v2.1/servers/7ad07221-7c50-403d-9d99-8f876d7b7c63/action => generated 14 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 26 15:03:12.930035 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-08a65456-7b84-4639-af2f-214002e19a4b tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:03:12.931029 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-08a65456-7b84-4639-af2f-214002e19a4b tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 757c7def-93df-481f-b40d-7115f4bbbefe] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:03:12.939567 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-08a65456-7b84-4639-af2f-214002e19a4b tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:12.940357 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-08a65456-7b84-4639-af2f-214002e19a4b tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:12.941365 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-08a65456-7b84-4639-af2f-214002e19a4b tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:12.942046 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-08a65456-7b84-4639-af2f-214002e19a4b tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:13.208437 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-08a65456-7b84-4639-af2f-214002e19a4b tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "POST /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe/action" status: 200 len: 24532 microversion: 2.20 time: 0.282280 May 26 15:03:13.209454 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 416/869] 10.222.0.81 () {62 vars in 1319 bytes} [Wed May 26 15:03:12 2021] POST /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe/action => generated 24532 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 26 15:03:13.493205 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-415c22d4-2765-4989-aa88-cc341d31e590 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Action: 'create', calling method: .version_select at 0x7f441edb73a0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-655383652"}} {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:03:13.518462 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.quota [None req-415c22d4-2765-4989-aa88-cc341d31e590 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Getting quotas for project 83937b4f3831489289cd8aec97222f77. Resources: {'key_pairs'} {{(pid=118513) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 26 15:03:13.522505 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.quota [None req-415c22d4-2765-4989-aa88-cc341d31e590 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Getting quotas for user bdf31e2b7edd47c8835741c0dd03b7fe and project 83937b4f3831489289cd8aec97222f77. Resources: {'key_pairs'} {{(pid=118513) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 26 15:03:13.905377 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-2d0fe24e-4c27-4d12-b5cc-013925ae49fd tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:03:13.906472 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-2d0fe24e-4c27-4d12-b5cc-013925ae49fd tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: 7ad07221-7c50-403d-9d99-8f876d7b7c63] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:03:13.914311 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-2d0fe24e-4c27-4d12-b5cc-013925ae49fd tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:13.914769 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-2d0fe24e-4c27-4d12-b5cc-013925ae49fd tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:13.915577 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-2d0fe24e-4c27-4d12-b5cc-013925ae49fd tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:13.916022 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-2d0fe24e-4c27-4d12-b5cc-013925ae49fd tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:14.007804 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-2d0fe24e-4c27-4d12-b5cc-013925ae49fd tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "POST /compute/v2.1/servers/7ad07221-7c50-403d-9d99-8f876d7b7c63/action" status: 200 len: 14 microversion: 2.1 time: 0.107199 May 26 15:03:14.008580 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 417/870] 10.222.0.81 () {60 vars in 1278 bytes} [Wed May 26 15:03:13 2021] POST /compute/v2.1/servers/7ad07221-7c50-403d-9d99-8f876d7b7c63/action => generated 14 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 26 15:03:14.027899 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.quota [None req-415c22d4-2765-4989-aa88-cc341d31e590 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Getting quotas for project 83937b4f3831489289cd8aec97222f77. Resources: {'key_pairs'} {{(pid=118513) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 26 15:03:14.031761 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.quota [None req-415c22d4-2765-4989-aa88-cc341d31e590 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Getting quotas for user bdf31e2b7edd47c8835741c0dd03b7fe and project 83937b4f3831489289cd8aec97222f77. Resources: {'key_pairs'} {{(pid=118513) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 26 15:03:14.044049 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-415c22d4-2765-4989-aa88-cc341d31e590 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 200 len: 2317 microversion: 2.1 time: 0.555032 May 26 15:03:14.044830 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 454/871] 10.222.0.81 () {60 vars in 1158 bytes} [Wed May 26 15:03:13 2021] POST /compute/v2.1/os-keypairs => generated 2317 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:03:14.099045 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-88afe251-555b-48a5-85e2-e632cd9c639c tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1251004524", "imageRef": "9326b1d2-6e5c-4e82-af60-84b6776756a6", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-655383652", "networks": [{"uuid": "91d594ee-93aa-497d-af26-3f3353865830"}]}} {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:03:14.165152 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.network.neutron [None req-88afe251-555b-48a5-85e2-e632cd9c639c tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] validate_networks() for [('91d594ee-93aa-497d-af26-3f3353865830', None, None, None)] {{(pid=118514) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} May 26 15:03:14.220830 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-e4a018fc-cc40-4cb2-b676-b69bf43d7728 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:03:14.222117 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-e4a018fc-cc40-4cb2-b676-b69bf43d7728 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 757c7def-93df-481f-b40d-7115f4bbbefe] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:03:14.230309 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-e4a018fc-cc40-4cb2-b676-b69bf43d7728 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:14.230771 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-e4a018fc-cc40-4cb2-b676-b69bf43d7728 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:14.231562 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-e4a018fc-cc40-4cb2-b676-b69bf43d7728 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:14.232052 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-e4a018fc-cc40-4cb2-b676-b69bf43d7728 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:14.329764 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-e4a018fc-cc40-4cb2-b676-b69bf43d7728 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "POST /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe/action" status: 200 len: 26127 microversion: 2.20 time: 0.113086 May 26 15:03:14.333805 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 455/872] 10.222.0.81 () {62 vars in 1319 bytes} [Wed May 26 15:03:14 2021] POST /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe/action => generated 26127 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 26 15:03:14.748693 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.virt.hardware [None req-88afe251-555b-48a5-85e2-e632cd9c639c tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Flavor limits 0:0:0 {{(pid=118514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} May 26 15:03:14.749180 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.virt.hardware [None req-88afe251-555b-48a5-85e2-e632cd9c639c tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Image limits 0:0:0 {{(pid=118514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} May 26 15:03:14.749724 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.virt.hardware [None req-88afe251-555b-48a5-85e2-e632cd9c639c tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Flavor pref 0:0:0 {{(pid=118514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} May 26 15:03:14.750147 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.virt.hardware [None req-88afe251-555b-48a5-85e2-e632cd9c639c tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Image pref 0:0:0 {{(pid=118514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} May 26 15:03:14.750570 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.virt.hardware [None req-88afe251-555b-48a5-85e2-e632cd9c639c tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118514) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} May 26 15:03:14.758958 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-88afe251-555b-48a5-85e2-e632cd9c639c tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:14.759417 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-88afe251-555b-48a5-85e2-e632cd9c639c tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:14.760226 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-88afe251-555b-48a5-85e2-e632cd9c639c tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:14.760670 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-88afe251-555b-48a5-85e2-e632cd9c639c tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:14.778127 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.quota [None req-88afe251-555b-48a5-85e2-e632cd9c639c tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Getting quotas for project 83937b4f3831489289cd8aec97222f77. Resources: {'instances', 'ram', 'cores'} {{(pid=118514) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 26 15:03:14.782831 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.quota [None req-88afe251-555b-48a5-85e2-e632cd9c639c tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Getting quotas for user bdf31e2b7edd47c8835741c0dd03b7fe and project 83937b4f3831489289cd8aec97222f77. Resources: {'instances', 'ram', 'cores'} {{(pid=118514) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 26 15:03:14.793165 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-88afe251-555b-48a5-85e2-e632cd9c639c tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Going to run 1 instances... {{(pid=118514) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 26 15:03:14.796083 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-88afe251-555b-48a5-85e2-e632cd9c639c tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] [instance: 40591370-dbd3-45b4-b6c6-a0e01a614c28] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9326b1d2-6e5c-4e82-af60-84b6776756a6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118514) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} May 26 15:03:14.918718 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-88afe251-555b-48a5-85e2-e632cd9c639c tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.823736 May 26 15:03:14.920177 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 418/873] 10.222.0.81 () {60 vars in 1147 bytes} [Wed May 26 15:03:14 2021] POST /compute/v2.1/servers => generated 380 bytes in 825 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 15:03:14.933834 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-348c903c-e639-43c4-93c8-46dc611f14e8 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:03:14.934557 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-348c903c-e639-43c4-93c8-46dc611f14e8 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] [instance: 40591370-dbd3-45b4-b6c6-a0e01a614c28] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:03:15.021092 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-67e265e5-26e7-4a43-96fa-a0b216d36f1a tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:03:15.022123 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-67e265e5-26e7-4a43-96fa-a0b216d36f1a tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: 7ad07221-7c50-403d-9d99-8f876d7b7c63] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:03:15.030926 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-67e265e5-26e7-4a43-96fa-a0b216d36f1a tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:15.031377 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-67e265e5-26e7-4a43-96fa-a0b216d36f1a tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:15.032154 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-67e265e5-26e7-4a43-96fa-a0b216d36f1a tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:15.032595 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-67e265e5-26e7-4a43-96fa-a0b216d36f1a tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:15.101064 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-348c903c-e639-43c4-93c8-46dc611f14e8 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf31e2b7edd47c8835741c0dd03b7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83937b4f3831489289cd8aec97222f77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:03:15.109862 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-348c903c-e639-43c4-93c8-46dc611f14e8 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] 10.222.0.81 "GET /compute/v2.1/servers/40591370-dbd3-45b4-b6c6-a0e01a614c28" status: 200 len: 1258 microversion: 2.1 time: 0.183713 May 26 15:03:15.110430 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 456/874] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:03:14 2021] GET /compute/v2.1/servers/40591370-dbd3-45b4-b6c6-a0e01a614c28 => generated 1258 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:03:15.130965 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-67e265e5-26e7-4a43-96fa-a0b216d36f1a tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "POST /compute/v2.1/servers/7ad07221-7c50-403d-9d99-8f876d7b7c63/action" status: 200 len: 14 microversion: 2.1 time: 0.114490 May 26 15:03:15.131744 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 419/875] 10.222.0.81 () {60 vars in 1278 bytes} [Wed May 26 15:03:15 2021] POST /compute/v2.1/servers/7ad07221-7c50-403d-9d99-8f876d7b7c63/action => generated 14 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 26 15:03:15.341251 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-b92369b1-ee05-4d04-8f1c-b0062451b2a3 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:03:15.342216 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-b92369b1-ee05-4d04-8f1c-b0062451b2a3 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 757c7def-93df-481f-b40d-7115f4bbbefe] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:03:15.351637 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-b92369b1-ee05-4d04-8f1c-b0062451b2a3 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:15.352150 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-b92369b1-ee05-4d04-8f1c-b0062451b2a3 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:15.353091 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-b92369b1-ee05-4d04-8f1c-b0062451b2a3 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:15.353558 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-b92369b1-ee05-4d04-8f1c-b0062451b2a3 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:15.465596 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-b92369b1-ee05-4d04-8f1c-b0062451b2a3 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "POST /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe/action" status: 200 len: 27361 microversion: 2.20 time: 0.127903 May 26 15:03:15.466838 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 457/876] 10.222.0.81 () {62 vars in 1319 bytes} [Wed May 26 15:03:15 2021] POST /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe/action => generated 27361 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 26 15:03:16.127420 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-c5bfa8d2-72d4-48d0-a924-69489eb01e26 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:03:16.128163 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-c5bfa8d2-72d4-48d0-a924-69489eb01e26 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] [instance: 40591370-dbd3-45b4-b6c6-a0e01a614c28] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:03:16.136279 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-c5bfa8d2-72d4-48d0-a924-69489eb01e26 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:16.136734 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-c5bfa8d2-72d4-48d0-a924-69489eb01e26 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:16.137522 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-c5bfa8d2-72d4-48d0-a924-69489eb01e26 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:16.137994 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-c5bfa8d2-72d4-48d0-a924-69489eb01e26 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:16.142456 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-a2748b15-4bcc-448d-88dc-12be109e9c26 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:03:16.143541 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-a2748b15-4bcc-448d-88dc-12be109e9c26 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: 7ad07221-7c50-403d-9d99-8f876d7b7c63] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:03:16.151905 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-a2748b15-4bcc-448d-88dc-12be109e9c26 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:16.152435 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-a2748b15-4bcc-448d-88dc-12be109e9c26 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:16.153314 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-a2748b15-4bcc-448d-88dc-12be109e9c26 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:16.154665 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-a2748b15-4bcc-448d-88dc-12be109e9c26 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:16.256521 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-a2748b15-4bcc-448d-88dc-12be109e9c26 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "POST /compute/v2.1/servers/7ad07221-7c50-403d-9d99-8f876d7b7c63/action" status: 200 len: 14 microversion: 2.1 time: 0.118625 May 26 15:03:16.259710 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 458/877] 10.222.0.81 () {60 vars in 1278 bytes} [Wed May 26 15:03:16 2021] POST /compute/v2.1/servers/7ad07221-7c50-403d-9d99-8f876d7b7c63/action => generated 14 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 26 15:03:16.265303 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-c5bfa8d2-72d4-48d0-a924-69489eb01e26 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf31e2b7edd47c8835741c0dd03b7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83937b4f3831489289cd8aec97222f77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:03:16.269944 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-c5bfa8d2-72d4-48d0-a924-69489eb01e26 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] 10.222.0.81 "GET /compute/v2.1/servers/40591370-dbd3-45b4-b6c6-a0e01a614c28" status: 200 len: 1262 microversion: 2.1 time: 0.146706 May 26 15:03:16.270515 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 420/878] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:03:16 2021] GET /compute/v2.1/servers/40591370-dbd3-45b4-b6c6-a0e01a614c28 => generated 1262 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:03:16.478616 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-110a0882-483f-4192-b934-55a933421f34 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:03:16.479736 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-110a0882-483f-4192-b934-55a933421f34 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 757c7def-93df-481f-b40d-7115f4bbbefe] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:03:16.488103 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-110a0882-483f-4192-b934-55a933421f34 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:16.488566 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-110a0882-483f-4192-b934-55a933421f34 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:16.489351 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-110a0882-483f-4192-b934-55a933421f34 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:16.489826 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-110a0882-483f-4192-b934-55a933421f34 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:16.588944 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-110a0882-483f-4192-b934-55a933421f34 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "POST /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe/action" status: 200 len: 27853 microversion: 2.20 time: 0.114688 May 26 15:03:16.592476 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 459/879] 10.222.0.81 () {62 vars in 1319 bytes} [Wed May 26 15:03:16 2021] POST /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe/action => generated 27853 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 26 15:03:17.270333 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-28cd472c-26d8-41e3-9e41-130d34a93d33 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:03:17.271275 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-28cd472c-26d8-41e3-9e41-130d34a93d33 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: 7ad07221-7c50-403d-9d99-8f876d7b7c63] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:03:17.281387 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-28cd472c-26d8-41e3-9e41-130d34a93d33 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:17.282058 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-28cd472c-26d8-41e3-9e41-130d34a93d33 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:17.282820 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-28cd472c-26d8-41e3-9e41-130d34a93d33 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:17.283262 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-28cd472c-26d8-41e3-9e41-130d34a93d33 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:17.287679 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-07374088-3c8a-4788-855a-b1a4cb220f88 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:03:17.289524 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-07374088-3c8a-4788-855a-b1a4cb220f88 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] [instance: 40591370-dbd3-45b4-b6c6-a0e01a614c28] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:03:17.297701 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-07374088-3c8a-4788-855a-b1a4cb220f88 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:17.298229 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-07374088-3c8a-4788-855a-b1a4cb220f88 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:17.299085 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-07374088-3c8a-4788-855a-b1a4cb220f88 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:17.299639 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-07374088-3c8a-4788-855a-b1a4cb220f88 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:17.384709 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-28cd472c-26d8-41e3-9e41-130d34a93d33 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "POST /compute/v2.1/servers/7ad07221-7c50-403d-9d99-8f876d7b7c63/action" status: 200 len: 14 microversion: 2.1 time: 0.120906 May 26 15:03:17.387993 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 421/880] 10.222.0.81 () {60 vars in 1278 bytes} [Wed May 26 15:03:17 2021] POST /compute/v2.1/servers/7ad07221-7c50-403d-9d99-8f876d7b7c63/action => generated 14 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 26 15:03:17.425305 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-07374088-3c8a-4788-855a-b1a4cb220f88 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf31e2b7edd47c8835741c0dd03b7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83937b4f3831489289cd8aec97222f77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:03:17.436624 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-07374088-3c8a-4788-855a-b1a4cb220f88 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] 10.222.0.81 "GET /compute/v2.1/servers/40591370-dbd3-45b4-b6c6-a0e01a614c28" status: 200 len: 1318 microversion: 2.1 time: 0.152754 May 26 15:03:17.438074 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 460/881] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:03:17 2021] GET /compute/v2.1/servers/40591370-dbd3-45b4-b6c6-a0e01a614c28 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:03:17.602299 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-13f89bca-9126-4aa5-a7fa-8d5c4fb494d9 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:03:17.603314 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-13f89bca-9126-4aa5-a7fa-8d5c4fb494d9 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 757c7def-93df-481f-b40d-7115f4bbbefe] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:03:17.611124 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-13f89bca-9126-4aa5-a7fa-8d5c4fb494d9 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:17.611730 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-13f89bca-9126-4aa5-a7fa-8d5c4fb494d9 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:17.612524 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-13f89bca-9126-4aa5-a7fa-8d5c4fb494d9 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:17.612977 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-13f89bca-9126-4aa5-a7fa-8d5c4fb494d9 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:17.714362 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-13f89bca-9126-4aa5-a7fa-8d5c4fb494d9 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "POST /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe/action" status: 200 len: 28203 microversion: 2.20 time: 0.116393 May 26 15:03:17.718360 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 422/882] 10.222.0.81 () {62 vars in 1319 bytes} [Wed May 26 15:03:17 2021] POST /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe/action => generated 28203 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 26 15:03:18.396529 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-be245ef7-636e-463e-b547-ffc4dfa4681f tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:03:18.397449 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-be245ef7-636e-463e-b547-ffc4dfa4681f tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: 7ad07221-7c50-403d-9d99-8f876d7b7c63] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:03:18.405809 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-be245ef7-636e-463e-b547-ffc4dfa4681f tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:18.415601 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-be245ef7-636e-463e-b547-ffc4dfa4681f tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:18.416824 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-be245ef7-636e-463e-b547-ffc4dfa4681f tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:18.417391 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-be245ef7-636e-463e-b547-ffc4dfa4681f tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:18.464078 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-72161a5c-fb3b-44a6-b204-1fb5ca76295e tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:03:18.464078 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-72161a5c-fb3b-44a6-b204-1fb5ca76295e tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] [instance: 40591370-dbd3-45b4-b6c6-a0e01a614c28] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:03:18.475771 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-72161a5c-fb3b-44a6-b204-1fb5ca76295e tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:18.476928 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-72161a5c-fb3b-44a6-b204-1fb5ca76295e tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:18.478552 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-72161a5c-fb3b-44a6-b204-1fb5ca76295e tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:18.479391 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-72161a5c-fb3b-44a6-b204-1fb5ca76295e tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:18.808406 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-72161a5c-fb3b-44a6-b204-1fb5ca76295e tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf31e2b7edd47c8835741c0dd03b7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83937b4f3831489289cd8aec97222f77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:03:18.817077 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-72161a5c-fb3b-44a6-b204-1fb5ca76295e tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] 10.222.0.81 "GET /compute/v2.1/servers/40591370-dbd3-45b4-b6c6-a0e01a614c28" status: 200 len: 1358 microversion: 2.1 time: 0.365564 May 26 15:03:18.818256 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 423/883] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:03:18 2021] GET /compute/v2.1/servers/40591370-dbd3-45b4-b6c6-a0e01a614c28 => generated 1358 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:03:18.823641 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-2d7160fe-ef5d-464e-a63f-2eb58c437f77 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:03:18.824770 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-2d7160fe-ef5d-464e-a63f-2eb58c437f77 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 757c7def-93df-481f-b40d-7115f4bbbefe] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:03:18.835401 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-2d7160fe-ef5d-464e-a63f-2eb58c437f77 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:18.836172 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-2d7160fe-ef5d-464e-a63f-2eb58c437f77 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:18.837339 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-2d7160fe-ef5d-464e-a63f-2eb58c437f77 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:18.837889 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-2d7160fe-ef5d-464e-a63f-2eb58c437f77 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:30.168238 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-2d7160fe-ef5d-464e-a63f-2eb58c437f77 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "POST /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe/action" status: 200 len: 28662 microversion: 2.20 time: 11.348491 May 26 15:03:30.169005 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 424/884] 10.222.0.81 () {62 vars in 1319 bytes} [Wed May 26 15:03:18 2021] POST /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe/action => generated 28662 bytes in 11350 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 26 15:03:30.174482 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-e88431cf-9997-44a1-bf88-d8093b3ec60f tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:03:30.175199 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-e88431cf-9997-44a1-bf88-d8093b3ec60f tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] [instance: 40591370-dbd3-45b4-b6c6-a0e01a614c28] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:03:30.177406 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-be245ef7-636e-463e-b547-ffc4dfa4681f tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "POST /compute/v2.1/servers/7ad07221-7c50-403d-9d99-8f876d7b7c63/action" status: 200 len: 24609 microversion: 2.1 time: 11.784971 May 26 15:03:30.178570 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 461/885] 10.222.0.81 () {60 vars in 1278 bytes} [Wed May 26 15:03:18 2021] POST /compute/v2.1/servers/7ad07221-7c50-403d-9d99-8f876d7b7c63/action => generated 24609 bytes in 11787 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 15:03:30.183779 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-e88431cf-9997-44a1-bf88-d8093b3ec60f tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:30.188531 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-e88431cf-9997-44a1-bf88-d8093b3ec60f tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:30.188531 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-e88431cf-9997-44a1-bf88-d8093b3ec60f tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:30.188531 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-e88431cf-9997-44a1-bf88-d8093b3ec60f tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:30.586625 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-e88431cf-9997-44a1-bf88-d8093b3ec60f tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf31e2b7edd47c8835741c0dd03b7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83937b4f3831489289cd8aec97222f77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:03:30.595068 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-e88431cf-9997-44a1-bf88-d8093b3ec60f tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] 10.222.0.81 "GET /compute/v2.1/servers/40591370-dbd3-45b4-b6c6-a0e01a614c28" status: 200 len: 1358 microversion: 2.1 time: 0.424842 May 26 15:03:30.595646 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 425/886] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:03:30 2021] GET /compute/v2.1/servers/40591370-dbd3-45b4-b6c6-a0e01a614c28 => generated 1358 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:03:31.180908 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-01552250-575f-48af-8516-7992bb7d7fa2 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:03:31.181968 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-01552250-575f-48af-8516-7992bb7d7fa2 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 757c7def-93df-481f-b40d-7115f4bbbefe] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:03:31.189507 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-7daf33b5-d008-4a24-9bf3-e0ea6e3e1f14 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:03:31.190311 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-01552250-575f-48af-8516-7992bb7d7fa2 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:31.190533 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-7daf33b5-d008-4a24-9bf3-e0ea6e3e1f14 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: 7ad07221-7c50-403d-9d99-8f876d7b7c63] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:03:31.190774 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-01552250-575f-48af-8516-7992bb7d7fa2 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:31.191562 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-01552250-575f-48af-8516-7992bb7d7fa2 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:31.192008 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-01552250-575f-48af-8516-7992bb7d7fa2 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:31.198318 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-7daf33b5-d008-4a24-9bf3-e0ea6e3e1f14 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:31.198775 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-7daf33b5-d008-4a24-9bf3-e0ea6e3e1f14 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:31.199618 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-7daf33b5-d008-4a24-9bf3-e0ea6e3e1f14 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:31.199998 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-7daf33b5-d008-4a24-9bf3-e0ea6e3e1f14 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:31.295862 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-01552250-575f-48af-8516-7992bb7d7fa2 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "POST /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe/action" status: 200 len: 28662 microversion: 2.20 time: 0.118517 May 26 15:03:31.300628 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 462/887] 10.222.0.81 () {62 vars in 1319 bytes} [Wed May 26 15:03:31 2021] POST /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe/action => generated 28662 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 26 15:03:31.311570 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-7daf33b5-d008-4a24-9bf3-e0ea6e3e1f14 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "POST /compute/v2.1/servers/7ad07221-7c50-403d-9d99-8f876d7b7c63/action" status: 200 len: 25676 microversion: 2.1 time: 0.125621 May 26 15:03:31.313009 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 426/888] 10.222.0.81 () {60 vars in 1278 bytes} [Wed May 26 15:03:31 2021] POST /compute/v2.1/servers/7ad07221-7c50-403d-9d99-8f876d7b7c63/action => generated 25676 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 15:03:31.446464 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [req-3f6908f3-a971-4c34-a4be-281026c5add5 req-4fe4cb2c-aeb2-47a6-bbbe-02eee7b6122d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40591370-dbd3-45b4-b6c6-a0e01a614c28", "tag": "6431ed44-bb34-4a76-bf6a-5f589562735a"}]} {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:03:31.448221 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 15:03:31.448221 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: warnings.warn(msg) May 26 15:03:31.456862 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [req-3f6908f3-a971-4c34-a4be-281026c5add5 req-4fe4cb2c-aeb2-47a6-bbbe-02eee7b6122d service nova] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:31.457437 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [req-3f6908f3-a971-4c34-a4be-281026c5add5 req-4fe4cb2c-aeb2-47a6-bbbe-02eee7b6122d service nova] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:31.474109 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.compute.server_external_events [req-3f6908f3-a971-4c34-a4be-281026c5add5 req-4fe4cb2c-aeb2-47a6-bbbe-02eee7b6122d service nova] Creating event network-changed:6431ed44-bb34-4a76-bf6a-5f589562735a for instance 40591370-dbd3-45b4-b6c6-a0e01a614c28 on hv-cinder-78414 May 26 15:03:31.478769 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [req-3f6908f3-a971-4c34-a4be-281026c5add5 req-4fe4cb2c-aeb2-47a6-bbbe-02eee7b6122d service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.180125 May 26 15:03:31.479384 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 463/889] 10.222.0.81 () {64 vars in 1318 bytes} [Wed May 26 15:03:31 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:03:31.612294 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-98223691-17ba-4184-adc3-848346796866 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:03:31.613010 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-98223691-17ba-4184-adc3-848346796866 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] [instance: 40591370-dbd3-45b4-b6c6-a0e01a614c28] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:03:31.620861 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-98223691-17ba-4184-adc3-848346796866 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:31.621318 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-98223691-17ba-4184-adc3-848346796866 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:31.622964 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-98223691-17ba-4184-adc3-848346796866 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:31.623420 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-98223691-17ba-4184-adc3-848346796866 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:31.922491 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-98223691-17ba-4184-adc3-848346796866 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf31e2b7edd47c8835741c0dd03b7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83937b4f3831489289cd8aec97222f77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:03:31.931568 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-98223691-17ba-4184-adc3-848346796866 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] 10.222.0.81 "GET /compute/v2.1/servers/40591370-dbd3-45b4-b6c6-a0e01a614c28" status: 200 len: 1358 microversion: 2.1 time: 0.323430 May 26 15:03:31.932219 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 427/890] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:03:31 2021] GET /compute/v2.1/servers/40591370-dbd3-45b4-b6c6-a0e01a614c28 => generated 1358 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:03:32.309897 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-0ae485d2-7136-433c-9888-8ff9ccdd2ef6 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:03:32.312330 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-0ae485d2-7136-433c-9888-8ff9ccdd2ef6 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 757c7def-93df-481f-b40d-7115f4bbbefe] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:03:32.321581 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-0ae485d2-7136-433c-9888-8ff9ccdd2ef6 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:32.322397 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-0ae485d2-7136-433c-9888-8ff9ccdd2ef6 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:32.323479 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-0ae485d2-7136-433c-9888-8ff9ccdd2ef6 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:32.323920 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-68f0467f-8427-426b-94af-8843a4a063c7 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:03:32.324745 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-0ae485d2-7136-433c-9888-8ff9ccdd2ef6 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:32.324864 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-68f0467f-8427-426b-94af-8843a4a063c7 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: 7ad07221-7c50-403d-9d99-8f876d7b7c63] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:03:32.335326 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-68f0467f-8427-426b-94af-8843a4a063c7 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:32.335793 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-68f0467f-8427-426b-94af-8843a4a063c7 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:32.336591 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-68f0467f-8427-426b-94af-8843a4a063c7 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:32.346140 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-68f0467f-8427-426b-94af-8843a4a063c7 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:32.443903 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-0ae485d2-7136-433c-9888-8ff9ccdd2ef6 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "POST /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe/action" status: 200 len: 28662 microversion: 2.20 time: 0.139345 May 26 15:03:32.444578 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 464/891] 10.222.0.81 () {62 vars in 1319 bytes} [Wed May 26 15:03:32 2021] POST /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe/action => generated 28662 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 26 15:03:32.464615 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-68f0467f-8427-426b-94af-8843a4a063c7 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "POST /compute/v2.1/servers/7ad07221-7c50-403d-9d99-8f876d7b7c63/action" status: 200 len: 26813 microversion: 2.1 time: 0.144104 May 26 15:03:32.466125 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 428/892] 10.222.0.81 () {60 vars in 1278 bytes} [Wed May 26 15:03:32 2021] POST /compute/v2.1/servers/7ad07221-7c50-403d-9d99-8f876d7b7c63/action => generated 26813 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 15:03:32.948636 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-f676ae2c-c89f-491e-a416-e1e66eabf875 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:03:32.949266 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-f676ae2c-c89f-491e-a416-e1e66eabf875 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] [instance: 40591370-dbd3-45b4-b6c6-a0e01a614c28] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:03:32.957484 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-f676ae2c-c89f-491e-a416-e1e66eabf875 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:32.958104 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-f676ae2c-c89f-491e-a416-e1e66eabf875 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:32.958775 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-f676ae2c-c89f-491e-a416-e1e66eabf875 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:32.959227 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-f676ae2c-c89f-491e-a416-e1e66eabf875 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:33.238740 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-f676ae2c-c89f-491e-a416-e1e66eabf875 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf31e2b7edd47c8835741c0dd03b7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83937b4f3831489289cd8aec97222f77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:03:33.247710 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-f676ae2c-c89f-491e-a416-e1e66eabf875 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] 10.222.0.81 "GET /compute/v2.1/servers/40591370-dbd3-45b4-b6c6-a0e01a614c28" status: 200 len: 1358 microversion: 2.1 time: 0.303119 May 26 15:03:33.250032 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 465/893] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:03:32 2021] GET /compute/v2.1/servers/40591370-dbd3-45b4-b6c6-a0e01a614c28 => generated 1358 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:03:33.457462 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-b2756abc-4e68-4c8a-9b4c-43446f6fb186 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:03:33.458523 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-b2756abc-4e68-4c8a-9b4c-43446f6fb186 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 757c7def-93df-481f-b40d-7115f4bbbefe] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:03:33.466562 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-b2756abc-4e68-4c8a-9b4c-43446f6fb186 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:33.467019 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-b2756abc-4e68-4c8a-9b4c-43446f6fb186 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:33.467847 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-b2756abc-4e68-4c8a-9b4c-43446f6fb186 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:33.468465 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-b2756abc-4e68-4c8a-9b4c-43446f6fb186 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:33.476131 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-48c75b38-8ab1-4a2d-adf6-b695c28ce8f6 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:03:33.477052 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-48c75b38-8ab1-4a2d-adf6-b695c28ce8f6 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: 7ad07221-7c50-403d-9d99-8f876d7b7c63] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:03:33.484280 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-48c75b38-8ab1-4a2d-adf6-b695c28ce8f6 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:33.484794 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-48c75b38-8ab1-4a2d-adf6-b695c28ce8f6 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:33.485521 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-48c75b38-8ab1-4a2d-adf6-b695c28ce8f6 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:33.485988 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-48c75b38-8ab1-4a2d-adf6-b695c28ce8f6 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:33.580718 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-b2756abc-4e68-4c8a-9b4c-43446f6fb186 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "POST /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe/action" status: 200 len: 28662 microversion: 2.20 time: 0.128001 May 26 15:03:33.581355 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 429/894] 10.222.0.81 () {62 vars in 1319 bytes} [Wed May 26 15:03:33 2021] POST /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe/action => generated 28662 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 26 15:03:33.595412 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-48c75b38-8ab1-4a2d-adf6-b695c28ce8f6 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "POST /compute/v2.1/servers/7ad07221-7c50-403d-9d99-8f876d7b7c63/action" status: 200 len: 27643 microversion: 2.1 time: 0.122628 May 26 15:03:33.596045 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 466/895] 10.222.0.81 () {60 vars in 1278 bytes} [Wed May 26 15:03:33 2021] POST /compute/v2.1/servers/7ad07221-7c50-403d-9d99-8f876d7b7c63/action => generated 27643 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 26 15:03:34.265666 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-1a62d63f-fd9f-46ee-b67f-32d5da604089 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:03:34.266372 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-1a62d63f-fd9f-46ee-b67f-32d5da604089 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] [instance: 40591370-dbd3-45b4-b6c6-a0e01a614c28] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:03:34.274516 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-1a62d63f-fd9f-46ee-b67f-32d5da604089 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:34.274971 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-1a62d63f-fd9f-46ee-b67f-32d5da604089 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:34.275771 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-1a62d63f-fd9f-46ee-b67f-32d5da604089 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:34.276210 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-1a62d63f-fd9f-46ee-b67f-32d5da604089 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:34.474119 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-1a62d63f-fd9f-46ee-b67f-32d5da604089 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf31e2b7edd47c8835741c0dd03b7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83937b4f3831489289cd8aec97222f77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:03:34.482334 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-1a62d63f-fd9f-46ee-b67f-32d5da604089 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] 10.222.0.81 "GET /compute/v2.1/servers/40591370-dbd3-45b4-b6c6-a0e01a614c28" status: 200 len: 1358 microversion: 2.1 time: 0.221063 May 26 15:03:34.482896 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 430/896] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:03:34 2021] GET /compute/v2.1/servers/40591370-dbd3-45b4-b6c6-a0e01a614c28 => generated 1358 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:03:34.594137 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-b1ced013-695b-4214-bc4f-24e9e125b26a tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:03:34.595168 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-b1ced013-695b-4214-bc4f-24e9e125b26a tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 757c7def-93df-481f-b40d-7115f4bbbefe] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:03:34.606040 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-b1ced013-695b-4214-bc4f-24e9e125b26a tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:34.606426 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-fb00ac63-7748-439e-a2da-f460902f7c4d tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:03:34.606563 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-b1ced013-695b-4214-bc4f-24e9e125b26a tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:34.607299 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-b1ced013-695b-4214-bc4f-24e9e125b26a tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:34.607565 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-fb00ac63-7748-439e-a2da-f460902f7c4d tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: 7ad07221-7c50-403d-9d99-8f876d7b7c63] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:03:34.607743 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-b1ced013-695b-4214-bc4f-24e9e125b26a tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:34.614998 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-fb00ac63-7748-439e-a2da-f460902f7c4d tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:34.615456 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-fb00ac63-7748-439e-a2da-f460902f7c4d tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:34.616236 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-fb00ac63-7748-439e-a2da-f460902f7c4d tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:34.616674 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-fb00ac63-7748-439e-a2da-f460902f7c4d tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:34.720221 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-b1ced013-695b-4214-bc4f-24e9e125b26a tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "POST /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe/action" status: 200 len: 30287 microversion: 2.20 time: 0.131223 May 26 15:03:34.724099 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 467/897] 10.222.0.81 () {62 vars in 1319 bytes} [Wed May 26 15:03:34 2021] POST /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe/action => generated 30287 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 26 15:03:34.724260 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-fb00ac63-7748-439e-a2da-f460902f7c4d tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "POST /compute/v2.1/servers/7ad07221-7c50-403d-9d99-8f876d7b7c63/action" status: 200 len: 28116 microversion: 2.1 time: 0.120594 May 26 15:03:34.724260 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 431/898] 10.222.0.81 () {60 vars in 1278 bytes} [Wed May 26 15:03:34 2021] POST /compute/v2.1/servers/7ad07221-7c50-403d-9d99-8f876d7b7c63/action => generated 28116 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 26 15:03:35.500839 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-c1afbc10-9729-49ca-8f07-719ac90f3e4a tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:03:35.501596 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-c1afbc10-9729-49ca-8f07-719ac90f3e4a tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] [instance: 40591370-dbd3-45b4-b6c6-a0e01a614c28] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:03:35.509530 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-c1afbc10-9729-49ca-8f07-719ac90f3e4a tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:35.510013 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-c1afbc10-9729-49ca-8f07-719ac90f3e4a tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:35.510794 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-c1afbc10-9729-49ca-8f07-719ac90f3e4a tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:35.511240 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-c1afbc10-9729-49ca-8f07-719ac90f3e4a tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:35.705667 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-c1afbc10-9729-49ca-8f07-719ac90f3e4a tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf31e2b7edd47c8835741c0dd03b7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83937b4f3831489289cd8aec97222f77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:03:35.713805 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-c1afbc10-9729-49ca-8f07-719ac90f3e4a tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] 10.222.0.81 "GET /compute/v2.1/servers/40591370-dbd3-45b4-b6c6-a0e01a614c28" status: 200 len: 1358 microversion: 2.1 time: 0.217662 May 26 15:03:35.714372 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 468/899] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:03:35 2021] GET /compute/v2.1/servers/40591370-dbd3-45b4-b6c6-a0e01a614c28 => generated 1358 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:03:35.732651 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-3368e28a-2220-4a64-a9bb-05ed146e967d tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:03:35.734397 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-3368e28a-2220-4a64-a9bb-05ed146e967d tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 757c7def-93df-481f-b40d-7115f4bbbefe] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:03:35.734837 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-270a7dfe-71f3-4ef8-b433-1175499063a8 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:03:35.735755 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-270a7dfe-71f3-4ef8-b433-1175499063a8 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: 7ad07221-7c50-403d-9d99-8f876d7b7c63] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:03:35.742793 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-3368e28a-2220-4a64-a9bb-05ed146e967d tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:35.742991 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-270a7dfe-71f3-4ef8-b433-1175499063a8 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:35.743245 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-3368e28a-2220-4a64-a9bb-05ed146e967d tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:35.743369 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-270a7dfe-71f3-4ef8-b433-1175499063a8 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:35.744049 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-3368e28a-2220-4a64-a9bb-05ed146e967d tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:35.744176 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-270a7dfe-71f3-4ef8-b433-1175499063a8 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:35.744486 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-3368e28a-2220-4a64-a9bb-05ed146e967d tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:35.744601 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-270a7dfe-71f3-4ef8-b433-1175499063a8 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:35.845698 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-3368e28a-2220-4a64-a9bb-05ed146e967d tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "POST /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe/action" status: 200 len: 32090 microversion: 2.20 time: 0.117064 May 26 15:03:35.849207 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 432/900] 10.222.0.81 () {62 vars in 1319 bytes} [Wed May 26 15:03:35 2021] POST /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe/action => generated 32090 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 26 15:03:35.849369 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-270a7dfe-71f3-4ef8-b433-1175499063a8 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "POST /compute/v2.1/servers/7ad07221-7c50-403d-9d99-8f876d7b7c63/action" status: 200 len: 28243 microversion: 2.1 time: 0.117545 May 26 15:03:35.849369 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 469/901] 10.222.0.81 () {60 vars in 1278 bytes} [Wed May 26 15:03:35 2021] POST /compute/v2.1/servers/7ad07221-7c50-403d-9d99-8f876d7b7c63/action => generated 28243 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 26 15:03:36.731581 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-6de40a85-dbe8-4d8c-9ea9-666fa148b4db tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:03:36.732318 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-6de40a85-dbe8-4d8c-9ea9-666fa148b4db tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] [instance: 40591370-dbd3-45b4-b6c6-a0e01a614c28] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:03:36.740192 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-6de40a85-dbe8-4d8c-9ea9-666fa148b4db tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:36.740777 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-6de40a85-dbe8-4d8c-9ea9-666fa148b4db tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:36.741415 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-6de40a85-dbe8-4d8c-9ea9-666fa148b4db tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:36.741890 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-6de40a85-dbe8-4d8c-9ea9-666fa148b4db tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:36.859725 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-b0fbe164-af7f-4805-a7d9-09133d9f04da tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:03:36.860748 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-b0fbe164-af7f-4805-a7d9-09133d9f04da tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 757c7def-93df-481f-b40d-7115f4bbbefe] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:03:36.868806 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-b0fbe164-af7f-4805-a7d9-09133d9f04da tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:36.869267 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-b0fbe164-af7f-4805-a7d9-09133d9f04da tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:36.870082 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-b0fbe164-af7f-4805-a7d9-09133d9f04da tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:36.870536 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-b0fbe164-af7f-4805-a7d9-09133d9f04da tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:36.944773 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-6de40a85-dbe8-4d8c-9ea9-666fa148b4db tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf31e2b7edd47c8835741c0dd03b7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83937b4f3831489289cd8aec97222f77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:03:36.953019 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-6de40a85-dbe8-4d8c-9ea9-666fa148b4db tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] 10.222.0.81 "GET /compute/v2.1/servers/40591370-dbd3-45b4-b6c6-a0e01a614c28" status: 200 len: 1358 microversion: 2.1 time: 0.225492 May 26 15:03:36.953597 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 433/902] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:03:36 2021] GET /compute/v2.1/servers/40591370-dbd3-45b4-b6c6-a0e01a614c28 => generated 1358 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:03:36.966426 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-d4e4561d-bb35-4245-99cc-c08220126465 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:03:36.967568 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-d4e4561d-bb35-4245-99cc-c08220126465 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: 7ad07221-7c50-403d-9d99-8f876d7b7c63] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:03:36.970778 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-b0fbe164-af7f-4805-a7d9-09133d9f04da tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "POST /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe/action" status: 200 len: 33203 microversion: 2.20 time: 0.115849 May 26 15:03:36.973262 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 470/903] 10.222.0.81 () {62 vars in 1319 bytes} [Wed May 26 15:03:36 2021] POST /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe/action => generated 33203 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 26 15:03:36.975534 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-d4e4561d-bb35-4245-99cc-c08220126465 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:36.976062 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-d4e4561d-bb35-4245-99cc-c08220126465 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:36.976845 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-d4e4561d-bb35-4245-99cc-c08220126465 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:36.977282 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-d4e4561d-bb35-4245-99cc-c08220126465 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:37.078882 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-d4e4561d-bb35-4245-99cc-c08220126465 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "POST /compute/v2.1/servers/7ad07221-7c50-403d-9d99-8f876d7b7c63/action" status: 200 len: 28243 microversion: 2.1 time: 0.123895 May 26 15:03:37.079535 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 434/904] 10.222.0.81 () {60 vars in 1278 bytes} [Wed May 26 15:03:36 2021] POST /compute/v2.1/servers/7ad07221-7c50-403d-9d99-8f876d7b7c63/action => generated 28243 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 15:03:37.271609 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [req-9cb1fdc3-e411-49ab-a2f7-f4bf2d8cf602 req-a6e4707e-e470-4835-8cef-ba04f7a2d618 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40591370-dbd3-45b4-b6c6-a0e01a614c28", "name": "network-vif-plugged", "status": "completed", "tag": "6431ed44-bb34-4a76-bf6a-5f589562735a"}]} {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:03:37.273149 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 15:03:37.273149 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: warnings.warn(msg) May 26 15:03:37.282321 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [req-9cb1fdc3-e411-49ab-a2f7-f4bf2d8cf602 req-a6e4707e-e470-4835-8cef-ba04f7a2d618 service nova] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:37.282777 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [req-9cb1fdc3-e411-49ab-a2f7-f4bf2d8cf602 req-a6e4707e-e470-4835-8cef-ba04f7a2d618 service nova] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:37.302621 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.compute.server_external_events [req-9cb1fdc3-e411-49ab-a2f7-f4bf2d8cf602 req-a6e4707e-e470-4835-8cef-ba04f7a2d618 service nova] Creating event network-vif-plugged:6431ed44-bb34-4a76-bf6a-5f589562735a for instance 40591370-dbd3-45b4-b6c6-a0e01a614c28 on hv-cinder-78414 May 26 15:03:37.307102 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [req-9cb1fdc3-e411-49ab-a2f7-f4bf2d8cf602 req-a6e4707e-e470-4835-8cef-ba04f7a2d618 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.226399 May 26 15:03:37.307686 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 471/905] 10.222.0.81 () {64 vars in 1318 bytes} [Wed May 26 15:03:37 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:03:37.970573 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-a35c536a-e1ce-4900-af09-7810e8342f99 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:03:37.971207 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-a35c536a-e1ce-4900-af09-7810e8342f99 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] [instance: 40591370-dbd3-45b4-b6c6-a0e01a614c28] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:03:37.979087 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-a35c536a-e1ce-4900-af09-7810e8342f99 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:37.979545 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-a35c536a-e1ce-4900-af09-7810e8342f99 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:37.980323 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-a35c536a-e1ce-4900-af09-7810e8342f99 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:37.980764 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-a35c536a-e1ce-4900-af09-7810e8342f99 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:37.983102 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-caaa925d-3702-43b3-85d8-3b8dfca4048c tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:03:37.984517 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-caaa925d-3702-43b3-85d8-3b8dfca4048c tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 757c7def-93df-481f-b40d-7115f4bbbefe] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:03:37.992223 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-caaa925d-3702-43b3-85d8-3b8dfca4048c tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:37.997384 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-caaa925d-3702-43b3-85d8-3b8dfca4048c tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:37.997384 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-caaa925d-3702-43b3-85d8-3b8dfca4048c tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:37.997384 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-caaa925d-3702-43b3-85d8-3b8dfca4048c tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:38.100087 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-caaa925d-3702-43b3-85d8-3b8dfca4048c tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "POST /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe/action" status: 200 len: 34036 microversion: 2.20 time: 0.120616 May 26 15:03:38.100661 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 472/906] 10.222.0.81 () {62 vars in 1319 bytes} [Wed May 26 15:03:37 2021] POST /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe/action => generated 34036 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 26 15:03:38.105942 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-426dd215-72f4-4665-908f-3df91d83b576 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:03:38.106971 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-426dd215-72f4-4665-908f-3df91d83b576 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: 7ad07221-7c50-403d-9d99-8f876d7b7c63] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:03:38.115325 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-426dd215-72f4-4665-908f-3df91d83b576 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:38.115786 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-426dd215-72f4-4665-908f-3df91d83b576 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:38.116591 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-426dd215-72f4-4665-908f-3df91d83b576 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:38.117037 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-426dd215-72f4-4665-908f-3df91d83b576 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:38.217930 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-426dd215-72f4-4665-908f-3df91d83b576 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "POST /compute/v2.1/servers/7ad07221-7c50-403d-9d99-8f876d7b7c63/action" status: 200 len: 28534 microversion: 2.1 time: 0.115519 May 26 15:03:38.218590 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 473/907] 10.222.0.81 () {60 vars in 1278 bytes} [Wed May 26 15:03:38 2021] POST /compute/v2.1/servers/7ad07221-7c50-403d-9d99-8f876d7b7c63/action => generated 28534 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 15:03:38.270658 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-a35c536a-e1ce-4900-af09-7810e8342f99 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf31e2b7edd47c8835741c0dd03b7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83937b4f3831489289cd8aec97222f77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:03:38.279009 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-a35c536a-e1ce-4900-af09-7810e8342f99 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] 10.222.0.81 "GET /compute/v2.1/servers/40591370-dbd3-45b4-b6c6-a0e01a614c28" status: 200 len: 1358 microversion: 2.1 time: 0.313063 May 26 15:03:38.279581 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 435/908] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:03:37 2021] GET /compute/v2.1/servers/40591370-dbd3-45b4-b6c6-a0e01a614c28 => generated 1358 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:03:39.114704 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-e44e7b59-0aa3-442f-a413-e3524990ac98 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:03:39.115746 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-e44e7b59-0aa3-442f-a413-e3524990ac98 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 757c7def-93df-481f-b40d-7115f4bbbefe] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:03:39.123702 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-e44e7b59-0aa3-442f-a413-e3524990ac98 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:39.124217 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-e44e7b59-0aa3-442f-a413-e3524990ac98 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:39.124996 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-e44e7b59-0aa3-442f-a413-e3524990ac98 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:39.125435 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-e44e7b59-0aa3-442f-a413-e3524990ac98 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:39.230427 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-6162bf3d-848a-40f7-a885-385abcd40abb tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:03:39.231358 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-6162bf3d-848a-40f7-a885-385abcd40abb tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: 7ad07221-7c50-403d-9d99-8f876d7b7c63] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:03:39.238810 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-e44e7b59-0aa3-442f-a413-e3524990ac98 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "POST /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe/action" status: 200 len: 35035 microversion: 2.20 time: 0.129683 May 26 15:03:39.239476 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 474/909] 10.222.0.81 () {62 vars in 1319 bytes} [Wed May 26 15:03:39 2021] POST /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe/action => generated 35035 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 26 15:03:39.241573 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-6162bf3d-848a-40f7-a885-385abcd40abb tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:39.242386 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-6162bf3d-848a-40f7-a885-385abcd40abb tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:39.243695 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-6162bf3d-848a-40f7-a885-385abcd40abb tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:39.244472 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-6162bf3d-848a-40f7-a885-385abcd40abb tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:39.296743 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-25c4dcf6-0a93-4fdc-bbd2-adca02a0c09e tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:03:39.297450 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-25c4dcf6-0a93-4fdc-bbd2-adca02a0c09e tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] [instance: 40591370-dbd3-45b4-b6c6-a0e01a614c28] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:03:39.306252 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-25c4dcf6-0a93-4fdc-bbd2-adca02a0c09e tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:39.306717 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-25c4dcf6-0a93-4fdc-bbd2-adca02a0c09e tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:39.307510 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-25c4dcf6-0a93-4fdc-bbd2-adca02a0c09e tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:39.307951 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-25c4dcf6-0a93-4fdc-bbd2-adca02a0c09e tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:39.362245 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-6162bf3d-848a-40f7-a885-385abcd40abb tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "POST /compute/v2.1/servers/7ad07221-7c50-403d-9d99-8f876d7b7c63/action" status: 200 len: 28702 microversion: 2.1 time: 0.135836 May 26 15:03:39.367593 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 436/910] 10.222.0.81 () {60 vars in 1278 bytes} [Wed May 26 15:03:39 2021] POST /compute/v2.1/servers/7ad07221-7c50-403d-9d99-8f876d7b7c63/action => generated 28702 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 26 15:03:39.532857 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-25c4dcf6-0a93-4fdc-bbd2-adca02a0c09e tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf31e2b7edd47c8835741c0dd03b7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83937b4f3831489289cd8aec97222f77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:03:39.541214 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-25c4dcf6-0a93-4fdc-bbd2-adca02a0c09e tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] 10.222.0.81 "GET /compute/v2.1/servers/40591370-dbd3-45b4-b6c6-a0e01a614c28" status: 200 len: 1547 microversion: 2.1 time: 0.248893 May 26 15:03:39.541820 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 475/911] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:03:39 2021] GET /compute/v2.1/servers/40591370-dbd3-45b4-b6c6-a0e01a614c28 => generated 1547 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:03:39.557637 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-a6bfce19-853c-4470-b4a7-a325d1c0e3f1 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:03:39.558399 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-a6bfce19-853c-4470-b4a7-a325d1c0e3f1 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] [instance: 40591370-dbd3-45b4-b6c6-a0e01a614c28] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:03:39.566976 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-a6bfce19-853c-4470-b4a7-a325d1c0e3f1 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:39.567438 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-a6bfce19-853c-4470-b4a7-a325d1c0e3f1 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:39.568220 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-a6bfce19-853c-4470-b4a7-a325d1c0e3f1 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:39.568669 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-a6bfce19-853c-4470-b4a7-a325d1c0e3f1 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:39.766512 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-a6bfce19-853c-4470-b4a7-a325d1c0e3f1 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf31e2b7edd47c8835741c0dd03b7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83937b4f3831489289cd8aec97222f77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:03:39.775090 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-a6bfce19-853c-4470-b4a7-a325d1c0e3f1 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] 10.222.0.81 "GET /compute/v2.1/servers/40591370-dbd3-45b4-b6c6-a0e01a614c28" status: 200 len: 1547 microversion: 2.1 time: 0.221668 May 26 15:03:39.775655 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 437/912] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:03:39 2021] GET /compute/v2.1/servers/40591370-dbd3-45b4-b6c6-a0e01a614c28 => generated 1547 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:03:39.790896 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-6d794f37-0c85-4362-a66a-8b734c43ca12 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:03:39.794245 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 15:03:39.794245 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: warnings.warn(msg) May 26 15:03:39.795249 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-6d794f37-0c85-4362-a66a-8b734c43ca12 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bdf31e2b7edd47c8835741c0dd03b7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83937b4f3831489289cd8aec97222f77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:03:39.796545 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-6d794f37-0c85-4362-a66a-8b734c43ca12 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Searching by: {'deleted': False, 'project_id': '83937b4f3831489289cd8aec97222f77'} {{(pid=118513) get_all /opt/stack/nova/nova/compute/api.py:2832}} May 26 15:03:39.802049 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-6d794f37-0c85-4362-a66a-8b734c43ca12 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:39.802505 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-6d794f37-0c85-4362-a66a-8b734c43ca12 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:39.803314 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-6d794f37-0c85-4362-a66a-8b734c43ca12 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:39.803759 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-6d794f37-0c85-4362-a66a-8b734c43ca12 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:39.893561 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.multi_cell_list [None req-6d794f37-0c85-4362-a66a-8b734c43ca12 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=118513) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:371}} May 26 15:03:39.985263 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-6d794f37-0c85-4362-a66a-8b734c43ca12 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] 10.222.0.81 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.197792 May 26 15:03:39.985792 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 476/913] 10.222.0.81 () {58 vars in 1125 bytes} [Wed May 26 15:03:39 2021] GET /compute/v2.1/servers => generated 343 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:03:39.995862 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-dbe5ddb2-692d-46cb-92b0-f4c0895e2e12 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:03:39.996485 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-dbe5ddb2-692d-46cb-92b0-f4c0895e2e12 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] [instance: 40591370-dbd3-45b4-b6c6-a0e01a614c28] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:03:40.004337 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-dbe5ddb2-692d-46cb-92b0-f4c0895e2e12 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:40.004797 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-dbe5ddb2-692d-46cb-92b0-f4c0895e2e12 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:40.005688 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-dbe5ddb2-692d-46cb-92b0-f4c0895e2e12 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:40.006185 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-dbe5ddb2-692d-46cb-92b0-f4c0895e2e12 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:40.203458 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-dbe5ddb2-692d-46cb-92b0-f4c0895e2e12 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf31e2b7edd47c8835741c0dd03b7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83937b4f3831489289cd8aec97222f77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:03:40.212052 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-dbe5ddb2-692d-46cb-92b0-f4c0895e2e12 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] 10.222.0.81 "GET /compute/v2.1/servers/40591370-dbd3-45b4-b6c6-a0e01a614c28" status: 200 len: 1547 microversion: 2.1 time: 0.219897 May 26 15:03:40.212620 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 438/914] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:03:39 2021] GET /compute/v2.1/servers/40591370-dbd3-45b4-b6c6-a0e01a614c28 => generated 1547 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:03:40.250932 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-27f7c77e-88d1-4604-9883-cb450ba060e0 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:03:40.251905 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-27f7c77e-88d1-4604-9883-cb450ba060e0 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 757c7def-93df-481f-b40d-7115f4bbbefe] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:03:40.259136 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-27f7c77e-88d1-4604-9883-cb450ba060e0 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:40.259598 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-27f7c77e-88d1-4604-9883-cb450ba060e0 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:40.260370 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-27f7c77e-88d1-4604-9883-cb450ba060e0 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:40.260812 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-27f7c77e-88d1-4604-9883-cb450ba060e0 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:40.362218 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-27f7c77e-88d1-4604-9883-cb450ba060e0 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "POST /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe/action" status: 200 len: 36243 microversion: 2.20 time: 0.114791 May 26 15:03:40.366448 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 477/915] 10.222.0.81 () {62 vars in 1319 bytes} [Wed May 26 15:03:40 2021] POST /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe/action => generated 36243 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 26 15:03:40.375306 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-cded8707-6d14-4c77-912c-f6290c6f4bc0 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:03:40.376235 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-cded8707-6d14-4c77-912c-f6290c6f4bc0 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: 7ad07221-7c50-403d-9d99-8f876d7b7c63] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:03:40.383504 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-cded8707-6d14-4c77-912c-f6290c6f4bc0 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:40.383958 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-cded8707-6d14-4c77-912c-f6290c6f4bc0 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:40.386354 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-cded8707-6d14-4c77-912c-f6290c6f4bc0 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:40.386354 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-cded8707-6d14-4c77-912c-f6290c6f4bc0 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:40.481595 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-cded8707-6d14-4c77-912c-f6290c6f4bc0 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "POST /compute/v2.1/servers/7ad07221-7c50-403d-9d99-8f876d7b7c63/action" status: 200 len: 28702 microversion: 2.1 time: 0.109884 May 26 15:03:40.482241 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 439/916] 10.222.0.81 () {60 vars in 1278 bytes} [Wed May 26 15:03:40 2021] POST /compute/v2.1/servers/7ad07221-7c50-403d-9d99-8f876d7b7c63/action => generated 28702 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 15:03:41.375102 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-e3365e63-9dbd-4afc-b5b7-fa1600a32eaf tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:03:41.376034 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-e3365e63-9dbd-4afc-b5b7-fa1600a32eaf tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 757c7def-93df-481f-b40d-7115f4bbbefe] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:03:41.383948 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-e3365e63-9dbd-4afc-b5b7-fa1600a32eaf tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:41.384414 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-e3365e63-9dbd-4afc-b5b7-fa1600a32eaf tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:41.385200 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-e3365e63-9dbd-4afc-b5b7-fa1600a32eaf tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:41.385670 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-e3365e63-9dbd-4afc-b5b7-fa1600a32eaf tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:41.485511 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-e3365e63-9dbd-4afc-b5b7-fa1600a32eaf tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "POST /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe/action" status: 200 len: 37454 microversion: 2.20 time: 0.114639 May 26 15:03:41.486487 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 478/917] 10.222.0.81 () {62 vars in 1319 bytes} [Wed May 26 15:03:41 2021] POST /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe/action => generated 37454 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 26 15:03:41.494907 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-754609ec-d263-4cb9-8928-3eb36624b592 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:03:41.496006 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-754609ec-d263-4cb9-8928-3eb36624b592 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: 7ad07221-7c50-403d-9d99-8f876d7b7c63] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:03:41.503979 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-754609ec-d263-4cb9-8928-3eb36624b592 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:41.504428 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-754609ec-d263-4cb9-8928-3eb36624b592 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:41.505197 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-754609ec-d263-4cb9-8928-3eb36624b592 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:41.505682 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-754609ec-d263-4cb9-8928-3eb36624b592 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:41.604859 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-754609ec-d263-4cb9-8928-3eb36624b592 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "POST /compute/v2.1/servers/7ad07221-7c50-403d-9d99-8f876d7b7c63/action" status: 200 len: 28702 microversion: 2.1 time: 0.113874 May 26 15:03:41.605497 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 440/918] 10.222.0.81 () {60 vars in 1278 bytes} [Wed May 26 15:03:41 2021] POST /compute/v2.1/servers/7ad07221-7c50-403d-9d99-8f876d7b7c63/action => generated 28702 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 15:03:42.296009 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-83067f85-860f-4327-9dc1-b611297b0539 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "840f87cc-a058-4330-a131-b223fa4f4655"}} {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:03:42.297344 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-83067f85-860f-4327-9dc1-b611297b0539 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] [instance: 40591370-dbd3-45b4-b6c6-a0e01a614c28] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:03:42.305179 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-83067f85-860f-4327-9dc1-b611297b0539 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:42.305673 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-83067f85-860f-4327-9dc1-b611297b0539 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:42.306442 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-83067f85-860f-4327-9dc1-b611297b0539 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:42.306881 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-83067f85-860f-4327-9dc1-b611297b0539 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:42.497203 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-108fd7ea-c7a5-4640-acdf-e38b938b7966 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:03:42.498242 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-108fd7ea-c7a5-4640-acdf-e38b938b7966 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 757c7def-93df-481f-b40d-7115f4bbbefe] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:03:42.506821 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-108fd7ea-c7a5-4640-acdf-e38b938b7966 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:42.507216 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-108fd7ea-c7a5-4640-acdf-e38b938b7966 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:42.508002 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-108fd7ea-c7a5-4640-acdf-e38b938b7966 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:42.508441 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-108fd7ea-c7a5-4640-acdf-e38b938b7966 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:42.609641 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-108fd7ea-c7a5-4640-acdf-e38b938b7966 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "POST /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe/action" status: 200 len: 38216 microversion: 2.20 time: 0.116396 May 26 15:03:42.610312 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 441/919] 10.222.0.81 () {62 vars in 1319 bytes} [Wed May 26 15:03:42 2021] POST /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe/action => generated 38216 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 26 15:03:42.616571 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-6f8e436c-5859-44aa-a07f-fcbbfa3d2284 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:03:42.617580 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-6f8e436c-5859-44aa-a07f-fcbbfa3d2284 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: 7ad07221-7c50-403d-9d99-8f876d7b7c63] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:03:42.626141 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-6f8e436c-5859-44aa-a07f-fcbbfa3d2284 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:42.626601 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-6f8e436c-5859-44aa-a07f-fcbbfa3d2284 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:42.627386 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-6f8e436c-5859-44aa-a07f-fcbbfa3d2284 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:42.627823 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-6f8e436c-5859-44aa-a07f-fcbbfa3d2284 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:42.726358 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-6f8e436c-5859-44aa-a07f-fcbbfa3d2284 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "POST /compute/v2.1/servers/7ad07221-7c50-403d-9d99-8f876d7b7c63/action" status: 200 len: 28823 microversion: 2.1 time: 0.113405 May 26 15:03:42.727003 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 442/920] 10.222.0.81 () {60 vars in 1278 bytes} [Wed May 26 15:03:42 2021] POST /compute/v2.1/servers/7ad07221-7c50-403d-9d99-8f876d7b7c63/action => generated 28823 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 26 15:03:43.113461 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-83067f85-860f-4327-9dc1-b611297b0539 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] 10.222.0.81 "POST /compute/v2.1/servers/40591370-dbd3-45b4-b6c6-a0e01a614c28/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.821600 May 26 15:03:43.114135 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 479/921] 10.222.0.81 () {60 vars in 1323 bytes} [Wed May 26 15:03:42 2021] POST /compute/v2.1/servers/40591370-dbd3-45b4-b6c6-a0e01a614c28/os-volume_attachments => generated 194 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:03:43.622280 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-034ff2bc-66a8-4d56-93a6-bdd7be20b87b tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:03:43.623223 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-034ff2bc-66a8-4d56-93a6-bdd7be20b87b tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 757c7def-93df-481f-b40d-7115f4bbbefe] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:03:43.631909 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-034ff2bc-66a8-4d56-93a6-bdd7be20b87b tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:43.632361 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-034ff2bc-66a8-4d56-93a6-bdd7be20b87b tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:43.633127 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-034ff2bc-66a8-4d56-93a6-bdd7be20b87b tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:43.633583 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-034ff2bc-66a8-4d56-93a6-bdd7be20b87b tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:43.727281 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-034ff2bc-66a8-4d56-93a6-bdd7be20b87b tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "POST /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe/action" status: 200 len: 38216 microversion: 2.20 time: 0.109188 May 26 15:03:43.727942 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 443/922] 10.222.0.81 () {62 vars in 1319 bytes} [Wed May 26 15:03:43 2021] POST /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe/action => generated 38216 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 26 15:03:43.739528 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-db8d0752-07f2-4e72-bea4-3cafff8d7689 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:03:43.740584 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-db8d0752-07f2-4e72-bea4-3cafff8d7689 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: 7ad07221-7c50-403d-9d99-8f876d7b7c63] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:03:43.748763 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-db8d0752-07f2-4e72-bea4-3cafff8d7689 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:43.749991 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-db8d0752-07f2-4e72-bea4-3cafff8d7689 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:43.751705 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-db8d0752-07f2-4e72-bea4-3cafff8d7689 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:43.751705 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-db8d0752-07f2-4e72-bea4-3cafff8d7689 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:43.854319 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-db8d0752-07f2-4e72-bea4-3cafff8d7689 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "POST /compute/v2.1/servers/7ad07221-7c50-403d-9d99-8f876d7b7c63/action" status: 200 len: 30824 microversion: 2.1 time: 0.119103 May 26 15:03:43.854888 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 480/923] 10.222.0.81 () {60 vars in 1278 bytes} [Wed May 26 15:03:43 2021] POST /compute/v2.1/servers/7ad07221-7c50-403d-9d99-8f876d7b7c63/action => generated 30824 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 15:03:44.740606 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-60e84253-2386-4aef-85d4-dfc90c6862ee tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:03:44.741692 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-60e84253-2386-4aef-85d4-dfc90c6862ee tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 757c7def-93df-481f-b40d-7115f4bbbefe] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:03:44.749817 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-60e84253-2386-4aef-85d4-dfc90c6862ee tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:44.750430 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-60e84253-2386-4aef-85d4-dfc90c6862ee tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:44.751499 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-60e84253-2386-4aef-85d4-dfc90c6862ee tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:44.751937 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-60e84253-2386-4aef-85d4-dfc90c6862ee tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:44.848371 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-60e84253-2386-4aef-85d4-dfc90c6862ee tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "POST /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe/action" status: 200 len: 38216 microversion: 2.20 time: 0.111672 May 26 15:03:44.848904 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 444/924] 10.222.0.81 () {62 vars in 1319 bytes} [Wed May 26 15:03:44 2021] POST /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe/action => generated 38216 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) May 26 15:03:44.866963 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-d9d916eb-2c8b-467c-921c-4925893315a9 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:03:44.868004 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-d9d916eb-2c8b-467c-921c-4925893315a9 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: 7ad07221-7c50-403d-9d99-8f876d7b7c63] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:03:44.875947 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-d9d916eb-2c8b-467c-921c-4925893315a9 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:44.876407 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-d9d916eb-2c8b-467c-921c-4925893315a9 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:44.877222 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-d9d916eb-2c8b-467c-921c-4925893315a9 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:44.877702 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-d9d916eb-2c8b-467c-921c-4925893315a9 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:44.972536 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-d9d916eb-2c8b-467c-921c-4925893315a9 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "POST /compute/v2.1/servers/7ad07221-7c50-403d-9d99-8f876d7b7c63/action" status: 200 len: 32379 microversion: 2.1 time: 0.109515 May 26 15:03:44.973449 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 481/925] 10.222.0.81 () {60 vars in 1278 bytes} [Wed May 26 15:03:44 2021] POST /compute/v2.1/servers/7ad07221-7c50-403d-9d99-8f876d7b7c63/action => generated 32379 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 15:03:45.861411 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-5dd1f56e-7059-4d5a-ada7-a148db6bd315 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:03:45.862447 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-5dd1f56e-7059-4d5a-ada7-a148db6bd315 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 757c7def-93df-481f-b40d-7115f4bbbefe] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:03:45.870331 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-5dd1f56e-7059-4d5a-ada7-a148db6bd315 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:45.870809 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-5dd1f56e-7059-4d5a-ada7-a148db6bd315 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:45.871575 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-5dd1f56e-7059-4d5a-ada7-a148db6bd315 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:45.872022 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-5dd1f56e-7059-4d5a-ada7-a148db6bd315 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:45.966329 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-5dd1f56e-7059-4d5a-ada7-a148db6bd315 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "POST /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe/action" status: 200 len: 38357 microversion: 2.20 time: 0.109716 May 26 15:03:45.966991 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 445/926] 10.222.0.81 () {62 vars in 1319 bytes} [Wed May 26 15:03:45 2021] POST /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe/action => generated 38357 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) May 26 15:03:45.977731 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-2763df70-4923-425c-bf81-513d475c0815 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:03:45.978325 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-2763df70-4923-425c-bf81-513d475c0815 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 757c7def-93df-481f-b40d-7115f4bbbefe] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:03:45.985375 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-db74db95-d536-4426-ad14-84498d827521 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:03:45.986544 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-db74db95-d536-4426-ad14-84498d827521 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: 7ad07221-7c50-403d-9d99-8f876d7b7c63] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:03:45.987301 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-2763df70-4923-425c-bf81-513d475c0815 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:45.987704 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-2763df70-4923-425c-bf81-513d475c0815 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:45.988490 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-2763df70-4923-425c-bf81-513d475c0815 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:45.988935 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-2763df70-4923-425c-bf81-513d475c0815 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:45.994522 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-db74db95-d536-4426-ad14-84498d827521 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:45.994976 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-db74db95-d536-4426-ad14-84498d827521 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:45.995776 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-db74db95-d536-4426-ad14-84498d827521 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:45.996210 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-db74db95-d536-4426-ad14-84498d827521 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:46.047060 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-2763df70-4923-425c-bf81-513d475c0815 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe/ips" status: 200 len: 152 microversion: 2.20 time: 0.073026 May 26 15:03:46.047656 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 482/927] 10.222.0.81 () {60 vars in 1289 bytes} [Wed May 26 15:03:45 2021] GET /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe/ips => generated 152 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 15:03:46.093017 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-db74db95-d536-4426-ad14-84498d827521 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "POST /compute/v2.1/servers/7ad07221-7c50-403d-9d99-8f876d7b7c63/action" status: 200 len: 33469 microversion: 2.1 time: 0.112200 May 26 15:03:46.093839 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 446/928] 10.222.0.81 () {60 vars in 1278 bytes} [Wed May 26 15:03:45 2021] POST /compute/v2.1/servers/7ad07221-7c50-403d-9d99-8f876d7b7c63/action => generated 33469 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 26 15:03:46.918849 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-da95cccf-928f-4116-8054-8d7dcf1d509f tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:03:46.919351 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-da95cccf-928f-4116-8054-8d7dcf1d509f tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] [instance: 29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:03:46.926689 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-da95cccf-928f-4116-8054-8d7dcf1d509f tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:46.927150 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-da95cccf-928f-4116-8054-8d7dcf1d509f tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:46.927932 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-da95cccf-928f-4116-8054-8d7dcf1d509f tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:46.928379 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-da95cccf-928f-4116-8054-8d7dcf1d509f tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:46.987283 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.objects.instance [None req-da95cccf-928f-4116-8054-8d7dcf1d509f tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lazy-loading 'flavor' on Instance uuid 29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de {{(pid=118513) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 26 15:03:47.104936 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-3af76cbc-6b95-4bd6-a0ca-a7c5f61417a9 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:03:47.106007 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-3af76cbc-6b95-4bd6-a0ca-a7c5f61417a9 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: 7ad07221-7c50-403d-9d99-8f876d7b7c63] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:03:47.114246 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-3af76cbc-6b95-4bd6-a0ca-a7c5f61417a9 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:47.114704 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-3af76cbc-6b95-4bd6-a0ca-a7c5f61417a9 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:47.115485 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-3af76cbc-6b95-4bd6-a0ca-a7c5f61417a9 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:47.115927 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-3af76cbc-6b95-4bd6-a0ca-a7c5f61417a9 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:47.224103 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-3af76cbc-6b95-4bd6-a0ca-a7c5f61417a9 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "POST /compute/v2.1/servers/7ad07221-7c50-403d-9d99-8f876d7b7c63/action" status: 200 len: 34668 microversion: 2.1 time: 0.123060 May 26 15:03:47.224674 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 447/929] 10.222.0.81 () {60 vars in 1278 bytes} [Wed May 26 15:03:47 2021] POST /compute/v2.1/servers/7ad07221-7c50-403d-9d99-8f876d7b7c63/action => generated 34668 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 26 15:03:47.371155 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-da95cccf-928f-4116-8054-8d7dcf1d509f tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "POST /compute/v2.1/servers/29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de/action" status: 202 len: 0 microversion: 2.1 time: 0.455994 May 26 15:03:47.371724 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 483/930] 10.222.0.81 () {60 vars in 1278 bytes} [Wed May 26 15:03:46 2021] POST /compute/v2.1/servers/29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de/action => generated 0 bytes in 457 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 15:03:47.381140 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-03a09a9b-e519-4885-9866-40628524c741 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:03:47.381871 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-03a09a9b-e519-4885-9866-40628524c741 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] [instance: 29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:03:47.390001 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-03a09a9b-e519-4885-9866-40628524c741 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:47.390452 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-03a09a9b-e519-4885-9866-40628524c741 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:47.391235 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-03a09a9b-e519-4885-9866-40628524c741 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:47.391688 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-03a09a9b-e519-4885-9866-40628524c741 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:47.598937 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-03a09a9b-e519-4885-9866-40628524c741 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565618950dd54005a4a040f4dd0cbb33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c65d1e254f424ebfea8360aa697c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:03:47.607300 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-03a09a9b-e519-4885-9866-40628524c741 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /compute/v2.1/servers/29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de" status: 200 len: 1569 microversion: 2.1 time: 0.230199 May 26 15:03:47.607872 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 448/931] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:03:47 2021] GET /compute/v2.1/servers/29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de => generated 1569 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:03:48.237135 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-b975efcd-21fb-4465-9704-b9370dbad2f4 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:03:48.238176 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-b975efcd-21fb-4465-9704-b9370dbad2f4 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: 7ad07221-7c50-403d-9d99-8f876d7b7c63] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:03:48.245680 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-b975efcd-21fb-4465-9704-b9370dbad2f4 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:48.246144 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-b975efcd-21fb-4465-9704-b9370dbad2f4 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:48.246928 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-b975efcd-21fb-4465-9704-b9370dbad2f4 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:48.247378 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-b975efcd-21fb-4465-9704-b9370dbad2f4 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:48.344228 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-b975efcd-21fb-4465-9704-b9370dbad2f4 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "POST /compute/v2.1/servers/7ad07221-7c50-403d-9d99-8f876d7b7c63/action" status: 200 len: 35893 microversion: 2.1 time: 0.110664 May 26 15:03:48.344842 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 484/932] 10.222.0.81 () {60 vars in 1278 bytes} [Wed May 26 15:03:48 2021] POST /compute/v2.1/servers/7ad07221-7c50-403d-9d99-8f876d7b7c63/action => generated 35893 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 15:03:48.523894 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-eca7ed95-99ba-4281-8877-90d8d4800865 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:03:48.524410 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-eca7ed95-99ba-4281-8877-90d8d4800865 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 757c7def-93df-481f-b40d-7115f4bbbefe] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:03:48.532052 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-eca7ed95-99ba-4281-8877-90d8d4800865 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:48.532541 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-eca7ed95-99ba-4281-8877-90d8d4800865 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:48.533334 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-eca7ed95-99ba-4281-8877-90d8d4800865 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:48.533811 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-eca7ed95-99ba-4281-8877-90d8d4800865 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:48.589625 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.objects.instance [None req-eca7ed95-99ba-4281-8877-90d8d4800865 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lazy-loading 'flavor' on Instance uuid 757c7def-93df-481f-b40d-7115f4bbbefe {{(pid=118514) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 26 15:03:48.625692 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-d1aa9c43-650a-455b-9efe-9cadc5b508ca tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:03:48.626403 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-d1aa9c43-650a-455b-9efe-9cadc5b508ca tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] [instance: 29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:03:48.634372 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-d1aa9c43-650a-455b-9efe-9cadc5b508ca tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:48.634827 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-d1aa9c43-650a-455b-9efe-9cadc5b508ca tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:48.635607 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-d1aa9c43-650a-455b-9efe-9cadc5b508ca tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:48.636130 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-d1aa9c43-650a-455b-9efe-9cadc5b508ca tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:48.837435 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-d1aa9c43-650a-455b-9efe-9cadc5b508ca tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565618950dd54005a4a040f4dd0cbb33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c65d1e254f424ebfea8360aa697c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:03:48.845709 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-d1aa9c43-650a-455b-9efe-9cadc5b508ca tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /compute/v2.1/servers/29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de" status: 200 len: 1569 microversion: 2.1 time: 0.225104 May 26 15:03:48.846358 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 485/933] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:03:48 2021] GET /compute/v2.1/servers/29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de => generated 1569 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:03:49.207719 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-eca7ed95-99ba-4281-8877-90d8d4800865 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "POST /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe/action" status: 202 len: 0 microversion: 2.20 time: 0.687653 May 26 15:03:49.208421 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 449/934] 10.222.0.81 () {62 vars in 1319 bytes} [Wed May 26 15:03:48 2021] POST /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe/action => generated 0 bytes in 689 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 26 15:03:49.216444 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-44a432f2-ff12-4f31-baca-287f1426814c tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:03:49.217054 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-44a432f2-ff12-4f31-baca-287f1426814c tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 757c7def-93df-481f-b40d-7115f4bbbefe] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:03:49.225004 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-44a432f2-ff12-4f31-baca-287f1426814c tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:49.225462 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-44a432f2-ff12-4f31-baca-287f1426814c tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:49.226385 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-44a432f2-ff12-4f31-baca-287f1426814c tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:49.226832 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-44a432f2-ff12-4f31-baca-287f1426814c tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:49.356877 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-74fcf02a-05fe-4fa2-8b03-b3a627c11d58 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:03:49.357855 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-74fcf02a-05fe-4fa2-8b03-b3a627c11d58 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: 7ad07221-7c50-403d-9d99-8f876d7b7c63] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:03:49.366173 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-74fcf02a-05fe-4fa2-8b03-b3a627c11d58 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:49.366639 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-74fcf02a-05fe-4fa2-8b03-b3a627c11d58 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:49.367423 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-74fcf02a-05fe-4fa2-8b03-b3a627c11d58 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:49.367868 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-74fcf02a-05fe-4fa2-8b03-b3a627c11d58 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:49.423454 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-44a432f2-ff12-4f31-baca-287f1426814c tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:03:49.433270 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-44a432f2-ff12-4f31-baca-287f1426814c tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:03:49.434838 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-44a432f2-ff12-4f31-baca-287f1426814c tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:03:49.435971 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-44a432f2-ff12-4f31-baca-287f1426814c tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe" status: 200 len: 1724 microversion: 2.20 time: 0.223336 May 26 15:03:49.436526 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 486/935] 10.222.0.81 () {60 vars in 1277 bytes} [Wed May 26 15:03:49 2021] GET /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe => generated 1724 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:03:49.476444 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-74fcf02a-05fe-4fa2-8b03-b3a627c11d58 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "POST /compute/v2.1/servers/7ad07221-7c50-403d-9d99-8f876d7b7c63/action" status: 200 len: 36917 microversion: 2.1 time: 0.123586 May 26 15:03:49.477217 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 450/936] 10.222.0.81 () {60 vars in 1278 bytes} [Wed May 26 15:03:49 2021] POST /compute/v2.1/servers/7ad07221-7c50-403d-9d99-8f876d7b7c63/action => generated 36917 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 26 15:03:49.862442 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-7a3bb297-09cb-44d6-9535-c1421b749702 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:03:49.863135 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-7a3bb297-09cb-44d6-9535-c1421b749702 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] [instance: 29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:03:49.870780 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-7a3bb297-09cb-44d6-9535-c1421b749702 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:49.871231 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-7a3bb297-09cb-44d6-9535-c1421b749702 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:49.871998 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-7a3bb297-09cb-44d6-9535-c1421b749702 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:49.872437 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-7a3bb297-09cb-44d6-9535-c1421b749702 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:50.071099 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-7a3bb297-09cb-44d6-9535-c1421b749702 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565618950dd54005a4a040f4dd0cbb33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c65d1e254f424ebfea8360aa697c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:03:50.080895 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-7a3bb297-09cb-44d6-9535-c1421b749702 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /compute/v2.1/servers/29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de" status: 200 len: 1569 microversion: 2.1 time: 0.221952 May 26 15:03:50.081597 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 487/937] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:03:49 2021] GET /compute/v2.1/servers/29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de => generated 1569 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:03:50.455040 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-bda04ee1-2500-4be2-addf-1370131534da tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:03:50.455750 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-bda04ee1-2500-4be2-addf-1370131534da tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 757c7def-93df-481f-b40d-7115f4bbbefe] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:03:50.463794 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-bda04ee1-2500-4be2-addf-1370131534da tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:50.464250 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-bda04ee1-2500-4be2-addf-1370131534da tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:50.465034 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-bda04ee1-2500-4be2-addf-1370131534da tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:50.465482 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-bda04ee1-2500-4be2-addf-1370131534da tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:50.488803 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-8e16abaf-87ae-4564-b04c-cbc36921f7cd tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:03:50.490137 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-8e16abaf-87ae-4564-b04c-cbc36921f7cd tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: 7ad07221-7c50-403d-9d99-8f876d7b7c63] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:03:50.499075 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-8e16abaf-87ae-4564-b04c-cbc36921f7cd tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:50.500195 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-8e16abaf-87ae-4564-b04c-cbc36921f7cd tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:50.501048 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-8e16abaf-87ae-4564-b04c-cbc36921f7cd tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:50.501499 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-8e16abaf-87ae-4564-b04c-cbc36921f7cd tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:50.608215 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-8e16abaf-87ae-4564-b04c-cbc36921f7cd tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "POST /compute/v2.1/servers/7ad07221-7c50-403d-9d99-8f876d7b7c63/action" status: 200 len: 37915 microversion: 2.1 time: 0.122748 May 26 15:03:50.613354 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 488/938] 10.222.0.81 () {60 vars in 1278 bytes} [Wed May 26 15:03:50 2021] POST /compute/v2.1/servers/7ad07221-7c50-403d-9d99-8f876d7b7c63/action => generated 37915 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 26 15:03:50.664009 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-bda04ee1-2500-4be2-addf-1370131534da tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:03:50.673368 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-bda04ee1-2500-4be2-addf-1370131534da tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:03:50.674956 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-bda04ee1-2500-4be2-addf-1370131534da tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:03:50.676086 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-bda04ee1-2500-4be2-addf-1370131534da tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe" status: 200 len: 1724 microversion: 2.20 time: 0.225461 May 26 15:03:50.676652 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 451/939] 10.222.0.81 () {60 vars in 1277 bytes} [Wed May 26 15:03:50 2021] GET /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe => generated 1724 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:03:51.080627 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-f8582632-5233-4a46-9a90-832c9171e29b tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:03:51.081332 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-f8582632-5233-4a46-9a90-832c9171e29b tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] [instance: 40591370-dbd3-45b4-b6c6-a0e01a614c28] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:03:51.089210 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-f8582632-5233-4a46-9a90-832c9171e29b tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:51.089712 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-f8582632-5233-4a46-9a90-832c9171e29b tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:51.090493 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-f8582632-5233-4a46-9a90-832c9171e29b tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:51.090937 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-f8582632-5233-4a46-9a90-832c9171e29b tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:51.097684 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-c3b5935b-efaf-4b0e-b5ee-93ab9ef4b47f tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:03:51.098392 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-c3b5935b-efaf-4b0e-b5ee-93ab9ef4b47f tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] [instance: 29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:03:51.105711 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-c3b5935b-efaf-4b0e-b5ee-93ab9ef4b47f tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:51.106164 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-c3b5935b-efaf-4b0e-b5ee-93ab9ef4b47f tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:51.106931 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-c3b5935b-efaf-4b0e-b5ee-93ab9ef4b47f tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:51.107441 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-c3b5935b-efaf-4b0e-b5ee-93ab9ef4b47f tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:51.289480 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-f8582632-5233-4a46-9a90-832c9171e29b tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf31e2b7edd47c8835741c0dd03b7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83937b4f3831489289cd8aec97222f77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:03:51.299092 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-f8582632-5233-4a46-9a90-832c9171e29b tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] 10.222.0.81 "GET /compute/v2.1/servers/40591370-dbd3-45b4-b6c6-a0e01a614c28" status: 200 len: 1593 microversion: 2.1 time: 0.222604 May 26 15:03:51.299674 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 489/940] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:03:51 2021] GET /compute/v2.1/servers/40591370-dbd3-45b4-b6c6-a0e01a614c28 => generated 1593 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:03:51.309026 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-c3b5935b-efaf-4b0e-b5ee-93ab9ef4b47f tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565618950dd54005a4a040f4dd0cbb33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c65d1e254f424ebfea8360aa697c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:03:51.318099 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-c3b5935b-efaf-4b0e-b5ee-93ab9ef4b47f tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /compute/v2.1/servers/29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de" status: 200 len: 1569 microversion: 2.1 time: 0.224076 May 26 15:03:51.319410 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 452/941] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:03:51 2021] GET /compute/v2.1/servers/29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de => generated 1569 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:03:51.620224 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-0451da9b-165b-4a8b-b514-237081498e91 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:03:51.621270 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-0451da9b-165b-4a8b-b514-237081498e91 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: 7ad07221-7c50-403d-9d99-8f876d7b7c63] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:03:51.628592 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-0451da9b-165b-4a8b-b514-237081498e91 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:51.629059 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-0451da9b-165b-4a8b-b514-237081498e91 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:51.633790 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-0451da9b-165b-4a8b-b514-237081498e91 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:51.633790 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-0451da9b-165b-4a8b-b514-237081498e91 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:51.694119 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-f47c7bae-9114-49e4-ab2a-fea2a193f756 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:03:51.694733 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-f47c7bae-9114-49e4-ab2a-fea2a193f756 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 757c7def-93df-481f-b40d-7115f4bbbefe] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:03:51.702405 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-f47c7bae-9114-49e4-ab2a-fea2a193f756 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:51.702946 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-f47c7bae-9114-49e4-ab2a-fea2a193f756 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:51.703724 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-f47c7bae-9114-49e4-ab2a-fea2a193f756 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:51.704167 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-f47c7bae-9114-49e4-ab2a-fea2a193f756 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:51.737977 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-0451da9b-165b-4a8b-b514-237081498e91 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "POST /compute/v2.1/servers/7ad07221-7c50-403d-9d99-8f876d7b7c63/action" status: 200 len: 38233 microversion: 2.1 time: 0.121202 May 26 15:03:51.739525 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 490/942] 10.222.0.81 () {60 vars in 1278 bytes} [Wed May 26 15:03:51 2021] POST /compute/v2.1/servers/7ad07221-7c50-403d-9d99-8f876d7b7c63/action => generated 38233 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 26 15:03:51.974272 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-f47c7bae-9114-49e4-ab2a-fea2a193f756 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:03:51.983173 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-f47c7bae-9114-49e4-ab2a-fea2a193f756 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:03:51.985222 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-f47c7bae-9114-49e4-ab2a-fea2a193f756 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:03:51.986481 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-f47c7bae-9114-49e4-ab2a-fea2a193f756 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe" status: 200 len: 1724 microversion: 2.20 time: 0.296079 May 26 15:03:51.987052 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 453/943] 10.222.0.81 () {60 vars in 1277 bytes} [Wed May 26 15:03:51 2021] GET /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe => generated 1724 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 15:03:52.335760 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-da6c38d4-31c8-468c-b951-15b430a3eb27 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:03:52.336471 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-da6c38d4-31c8-468c-b951-15b430a3eb27 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] [instance: 29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:03:52.344837 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-da6c38d4-31c8-468c-b951-15b430a3eb27 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:52.345292 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-da6c38d4-31c8-468c-b951-15b430a3eb27 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:52.346119 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-da6c38d4-31c8-468c-b951-15b430a3eb27 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:52.346563 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-da6c38d4-31c8-468c-b951-15b430a3eb27 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:52.553385 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-da6c38d4-31c8-468c-b951-15b430a3eb27 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565618950dd54005a4a040f4dd0cbb33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c65d1e254f424ebfea8360aa697c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:03:52.561702 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-da6c38d4-31c8-468c-b951-15b430a3eb27 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /compute/v2.1/servers/29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de" status: 200 len: 1569 microversion: 2.1 time: 0.230169 May 26 15:03:52.562635 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 491/944] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:03:52 2021] GET /compute/v2.1/servers/29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de => generated 1569 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:03:52.750226 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-fb1ea670-f36e-46ec-914c-fc4ef4ee2dbd tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:03:52.751317 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-fb1ea670-f36e-46ec-914c-fc4ef4ee2dbd tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: 7ad07221-7c50-403d-9d99-8f876d7b7c63] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:03:52.758759 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-fb1ea670-f36e-46ec-914c-fc4ef4ee2dbd tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:52.759219 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-fb1ea670-f36e-46ec-914c-fc4ef4ee2dbd tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:52.760017 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-fb1ea670-f36e-46ec-914c-fc4ef4ee2dbd tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:52.760459 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-fb1ea670-f36e-46ec-914c-fc4ef4ee2dbd tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:52.858635 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-fb1ea670-f36e-46ec-914c-fc4ef4ee2dbd tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "POST /compute/v2.1/servers/7ad07221-7c50-403d-9d99-8f876d7b7c63/action" status: 200 len: 38233 microversion: 2.1 time: 0.111998 May 26 15:03:52.863156 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 454/945] 10.222.0.81 () {60 vars in 1278 bytes} [Wed May 26 15:03:52 2021] POST /compute/v2.1/servers/7ad07221-7c50-403d-9d99-8f876d7b7c63/action => generated 38233 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 15:03:53.005253 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-5f6e4f68-d6d3-4c43-a376-6fa8ab69a3ab tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:03:53.005820 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-5f6e4f68-d6d3-4c43-a376-6fa8ab69a3ab tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 757c7def-93df-481f-b40d-7115f4bbbefe] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:03:53.013007 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-5f6e4f68-d6d3-4c43-a376-6fa8ab69a3ab tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:53.013467 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-5f6e4f68-d6d3-4c43-a376-6fa8ab69a3ab tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:53.014281 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-5f6e4f68-d6d3-4c43-a376-6fa8ab69a3ab tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:53.014720 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-5f6e4f68-d6d3-4c43-a376-6fa8ab69a3ab tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:53.214763 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-5f6e4f68-d6d3-4c43-a376-6fa8ab69a3ab tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:03:53.223968 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-5f6e4f68-d6d3-4c43-a376-6fa8ab69a3ab tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:03:53.225461 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-5f6e4f68-d6d3-4c43-a376-6fa8ab69a3ab tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:03:53.226632 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-5f6e4f68-d6d3-4c43-a376-6fa8ab69a3ab tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe" status: 200 len: 1724 microversion: 2.20 time: 0.225289 May 26 15:03:53.227206 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 492/946] 10.222.0.81 () {60 vars in 1277 bytes} [Wed May 26 15:03:53 2021] GET /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe => generated 1724 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:03:53.579285 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-359a3acd-253e-4a74-b1ef-d450ad81fa50 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:03:53.579954 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-359a3acd-253e-4a74-b1ef-d450ad81fa50 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] [instance: 29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:03:53.588000 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-359a3acd-253e-4a74-b1ef-d450ad81fa50 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:53.588460 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-359a3acd-253e-4a74-b1ef-d450ad81fa50 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:53.589248 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-359a3acd-253e-4a74-b1ef-d450ad81fa50 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:53.589720 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-359a3acd-253e-4a74-b1ef-d450ad81fa50 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:53.871125 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-90436814-ec67-483b-93b6-1e16ed8ecf9b tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:03:53.871974 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-90436814-ec67-483b-93b6-1e16ed8ecf9b tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: 7ad07221-7c50-403d-9d99-8f876d7b7c63] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:03:53.880192 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-90436814-ec67-483b-93b6-1e16ed8ecf9b tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:53.880658 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-90436814-ec67-483b-93b6-1e16ed8ecf9b tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:53.881449 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-90436814-ec67-483b-93b6-1e16ed8ecf9b tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:53.881922 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-90436814-ec67-483b-93b6-1e16ed8ecf9b tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:53.981917 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-90436814-ec67-483b-93b6-1e16ed8ecf9b tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "POST /compute/v2.1/servers/7ad07221-7c50-403d-9d99-8f876d7b7c63/action" status: 200 len: 38362 microversion: 2.1 time: 0.114396 May 26 15:03:53.982843 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 493/947] 10.222.0.81 () {60 vars in 1278 bytes} [Wed May 26 15:03:53 2021] POST /compute/v2.1/servers/7ad07221-7c50-403d-9d99-8f876d7b7c63/action => generated 38362 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 26 15:03:53.993207 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-d9541e62-e523-4767-a206-aeedfb385bc8 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:03:53.994134 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-d9541e62-e523-4767-a206-aeedfb385bc8 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: 7ad07221-7c50-403d-9d99-8f876d7b7c63] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:03:54.002785 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-d9541e62-e523-4767-a206-aeedfb385bc8 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:54.004956 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-d9541e62-e523-4767-a206-aeedfb385bc8 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:54.004956 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-d9541e62-e523-4767-a206-aeedfb385bc8 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:54.004956 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-d9541e62-e523-4767-a206-aeedfb385bc8 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:54.060974 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-359a3acd-253e-4a74-b1ef-d450ad81fa50 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565618950dd54005a4a040f4dd0cbb33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c65d1e254f424ebfea8360aa697c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:03:54.066312 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-d9541e62-e523-4767-a206-aeedfb385bc8 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /compute/v2.1/servers/7ad07221-7c50-403d-9d99-8f876d7b7c63/ips" status: 200 len: 146 microversion: 2.1 time: 0.077250 May 26 15:03:54.067395 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 494/948] 10.222.0.81 () {58 vars in 1248 bytes} [Wed May 26 15:03:53 2021] GET /compute/v2.1/servers/7ad07221-7c50-403d-9d99-8f876d7b7c63/ips => generated 146 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:03:54.076078 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-359a3acd-253e-4a74-b1ef-d450ad81fa50 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /compute/v2.1/servers/29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de" status: 200 len: 1569 microversion: 2.1 time: 0.501025 May 26 15:03:54.080107 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 455/949] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:03:53 2021] GET /compute/v2.1/servers/29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de => generated 1569 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:03:54.244598 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-3c26f5bc-e1b3-4a44-bc99-d40a60c4a9dc tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:03:54.245510 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-3c26f5bc-e1b3-4a44-bc99-d40a60c4a9dc tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 757c7def-93df-481f-b40d-7115f4bbbefe] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:03:54.253041 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-3c26f5bc-e1b3-4a44-bc99-d40a60c4a9dc tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:54.253503 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-3c26f5bc-e1b3-4a44-bc99-d40a60c4a9dc tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:54.254514 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-3c26f5bc-e1b3-4a44-bc99-d40a60c4a9dc tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:54.254970 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-3c26f5bc-e1b3-4a44-bc99-d40a60c4a9dc tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:54.489056 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [req-72987be5-482e-4fcc-9189-a2f2988fe2c4 req-13619e69-7bf5-4084-a1a8-b0b37cd0199f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40591370-dbd3-45b4-b6c6-a0e01a614c28", "tag": "6431ed44-bb34-4a76-bf6a-5f589562735a"}]} {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:03:54.491032 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 15:03:54.491032 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: warnings.warn(msg) May 26 15:03:54.502280 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [req-72987be5-482e-4fcc-9189-a2f2988fe2c4 req-13619e69-7bf5-4084-a1a8-b0b37cd0199f service nova] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:54.503021 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [req-72987be5-482e-4fcc-9189-a2f2988fe2c4 req-13619e69-7bf5-4084-a1a8-b0b37cd0199f service nova] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:54.525121 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.compute.server_external_events [req-72987be5-482e-4fcc-9189-a2f2988fe2c4 req-13619e69-7bf5-4084-a1a8-b0b37cd0199f service nova] Creating event network-changed:6431ed44-bb34-4a76-bf6a-5f589562735a for instance 40591370-dbd3-45b4-b6c6-a0e01a614c28 on hv-cinder-78414 May 26 15:03:54.530222 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [req-72987be5-482e-4fcc-9189-a2f2988fe2c4 req-13619e69-7bf5-4084-a1a8-b0b37cd0199f service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045307 May 26 15:03:54.531920 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 456/950] 10.222.0.81 () {64 vars in 1318 bytes} [Wed May 26 15:03:54 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:03:54.689053 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-3c26f5bc-e1b3-4a44-bc99-d40a60c4a9dc tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:03:54.704005 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-3c26f5bc-e1b3-4a44-bc99-d40a60c4a9dc tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:03:54.711368 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-3c26f5bc-e1b3-4a44-bc99-d40a60c4a9dc tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:03:54.717152 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-3c26f5bc-e1b3-4a44-bc99-d40a60c4a9dc tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe" status: 200 len: 1724 microversion: 2.20 time: 0.474009 May 26 15:03:54.720963 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 495/951] 10.222.0.81 () {60 vars in 1277 bytes} [Wed May 26 15:03:54 2021] GET /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe => generated 1724 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:03:55.096990 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-bf243e34-83df-4321-818b-ff6d36a9d24b tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:03:55.097769 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-bf243e34-83df-4321-818b-ff6d36a9d24b tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] [instance: 29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:03:55.107403 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-bf243e34-83df-4321-818b-ff6d36a9d24b tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:55.107403 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-bf243e34-83df-4321-818b-ff6d36a9d24b tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:55.107712 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-bf243e34-83df-4321-818b-ff6d36a9d24b tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:55.108302 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-bf243e34-83df-4321-818b-ff6d36a9d24b tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:55.512829 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-bf243e34-83df-4321-818b-ff6d36a9d24b tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565618950dd54005a4a040f4dd0cbb33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c65d1e254f424ebfea8360aa697c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:03:55.524342 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-bf243e34-83df-4321-818b-ff6d36a9d24b tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /compute/v2.1/servers/29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de" status: 200 len: 1569 microversion: 2.1 time: 0.432711 May 26 15:03:55.525168 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 457/952] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:03:55 2021] GET /compute/v2.1/servers/29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de => generated 1569 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:03:55.738373 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-b3cb7b7c-43ea-4823-8998-ea3b93abbece tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:03:55.738992 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-b3cb7b7c-43ea-4823-8998-ea3b93abbece tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 757c7def-93df-481f-b40d-7115f4bbbefe] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:03:55.746734 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-b3cb7b7c-43ea-4823-8998-ea3b93abbece tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:55.747267 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-b3cb7b7c-43ea-4823-8998-ea3b93abbece tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:55.747999 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-b3cb7b7c-43ea-4823-8998-ea3b93abbece tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:55.748441 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-b3cb7b7c-43ea-4823-8998-ea3b93abbece tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:55.924290 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-dacadda6-bd0f-492a-8afc-0ae38a6524e1 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8b193835-40a9-49f2-aed9-699446ef0314"}} {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:03:55.925459 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-dacadda6-bd0f-492a-8afc-0ae38a6524e1 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: 7ad07221-7c50-403d-9d99-8f876d7b7c63] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:03:55.932943 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-dacadda6-bd0f-492a-8afc-0ae38a6524e1 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:55.946615 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-dacadda6-bd0f-492a-8afc-0ae38a6524e1 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:55.946615 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-dacadda6-bd0f-492a-8afc-0ae38a6524e1 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:55.946615 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-dacadda6-bd0f-492a-8afc-0ae38a6524e1 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:56.057330 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-b3cb7b7c-43ea-4823-8998-ea3b93abbece tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:03:56.067090 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-b3cb7b7c-43ea-4823-8998-ea3b93abbece tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:03:56.068700 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-b3cb7b7c-43ea-4823-8998-ea3b93abbece tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:03:56.069927 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-b3cb7b7c-43ea-4823-8998-ea3b93abbece tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe" status: 200 len: 1724 microversion: 2.20 time: 0.336035 May 26 15:03:56.070752 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 496/953] 10.222.0.81 () {60 vars in 1277 bytes} [Wed May 26 15:03:55 2021] GET /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe => generated 1724 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 15:03:56.541472 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-1674fbc5-4583-46e7-a38e-9b94771c1c55 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:03:56.542121 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-1674fbc5-4583-46e7-a38e-9b94771c1c55 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] [instance: 29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:03:56.549497 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-1674fbc5-4583-46e7-a38e-9b94771c1c55 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:56.550051 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-1674fbc5-4583-46e7-a38e-9b94771c1c55 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:56.550838 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-1674fbc5-4583-46e7-a38e-9b94771c1c55 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:56.551280 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-1674fbc5-4583-46e7-a38e-9b94771c1c55 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:56.708334 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-dacadda6-bd0f-492a-8afc-0ae38a6524e1 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "POST /compute/v2.1/servers/7ad07221-7c50-403d-9d99-8f876d7b7c63/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.788423 May 26 15:03:56.708998 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 458/954] 10.222.0.81 () {60 vars in 1323 bytes} [Wed May 26 15:03:55 2021] POST /compute/v2.1/servers/7ad07221-7c50-403d-9d99-8f876d7b7c63/os-volume_attachments => generated 194 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:03:56.760432 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-1674fbc5-4583-46e7-a38e-9b94771c1c55 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565618950dd54005a4a040f4dd0cbb33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c65d1e254f424ebfea8360aa697c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:03:56.771371 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-1674fbc5-4583-46e7-a38e-9b94771c1c55 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /compute/v2.1/servers/29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de" status: 200 len: 1569 microversion: 2.1 time: 0.233085 May 26 15:03:56.772150 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 497/955] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:03:56 2021] GET /compute/v2.1/servers/29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de => generated 1569 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:03:57.114099 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-a47d6fc9-b7be-4e14-8894-1ce4b56fee6d tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:03:57.114099 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-a47d6fc9-b7be-4e14-8894-1ce4b56fee6d tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 757c7def-93df-481f-b40d-7115f4bbbefe] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:03:57.114099 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-a47d6fc9-b7be-4e14-8894-1ce4b56fee6d tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:57.114099 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-a47d6fc9-b7be-4e14-8894-1ce4b56fee6d tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:57.114517 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-a47d6fc9-b7be-4e14-8894-1ce4b56fee6d tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:57.114517 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-a47d6fc9-b7be-4e14-8894-1ce4b56fee6d tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:57.299448 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-a47d6fc9-b7be-4e14-8894-1ce4b56fee6d tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:03:57.308323 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-a47d6fc9-b7be-4e14-8894-1ce4b56fee6d tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:03:57.309873 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-a47d6fc9-b7be-4e14-8894-1ce4b56fee6d tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:03:57.311066 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-a47d6fc9-b7be-4e14-8894-1ce4b56fee6d tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe" status: 200 len: 1724 microversion: 2.20 time: 0.226337 May 26 15:03:57.311637 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 459/956] 10.222.0.81 () {60 vars in 1277 bytes} [Wed May 26 15:03:57 2021] GET /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe => generated 1724 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:03:57.323292 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-e0cd30e2-e83e-4170-8ef3-e9abf666c47b tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-931696345"}} {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:03:57.323880 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-e0cd30e2-e83e-4170-8ef3-e9abf666c47b tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] [instance: 40591370-dbd3-45b4-b6c6-a0e01a614c28] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:03:57.332261 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-e0cd30e2-e83e-4170-8ef3-e9abf666c47b tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:57.332722 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-e0cd30e2-e83e-4170-8ef3-e9abf666c47b tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:57.333715 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-e0cd30e2-e83e-4170-8ef3-e9abf666c47b tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:57.334368 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-e0cd30e2-e83e-4170-8ef3-e9abf666c47b tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:57.594333 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.network.security_group_api [None req-e0cd30e2-e83e-4170-8ef3-e9abf666c47b tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Adding security group 26cf896a-b80b-402b-9c0b-61fd0465af2a to port 6431ed44-bb34-4a76-bf6a-5f589562735a May 26 15:03:57.788065 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-ab3c6481-7e1b-4d14-87c1-8a2e55909cca tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:03:57.788680 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-ab3c6481-7e1b-4d14-87c1-8a2e55909cca tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] [instance: 29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:03:57.795944 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-ab3c6481-7e1b-4d14-87c1-8a2e55909cca tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:57.797165 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-ab3c6481-7e1b-4d14-87c1-8a2e55909cca tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:57.797995 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-ab3c6481-7e1b-4d14-87c1-8a2e55909cca tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:57.798442 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-ab3c6481-7e1b-4d14-87c1-8a2e55909cca tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:58.001661 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-ab3c6481-7e1b-4d14-87c1-8a2e55909cca tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565618950dd54005a4a040f4dd0cbb33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c65d1e254f424ebfea8360aa697c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:03:58.010292 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-ab3c6481-7e1b-4d14-87c1-8a2e55909cca tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /compute/v2.1/servers/29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de" status: 200 len: 1569 microversion: 2.1 time: 0.225937 May 26 15:03:58.010872 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 460/957] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:03:57 2021] GET /compute/v2.1/servers/29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de => generated 1569 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:03:58.152679 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-e0cd30e2-e83e-4170-8ef3-e9abf666c47b tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] 10.222.0.81 "POST /compute/v2.1/servers/40591370-dbd3-45b4-b6c6-a0e01a614c28/action" status: 202 len: 0 microversion: 2.1 time: 0.833324 May 26 15:03:58.153685 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 498/958] 10.222.0.81 () {60 vars in 1278 bytes} [Wed May 26 15:03:57 2021] POST /compute/v2.1/servers/40591370-dbd3-45b4-b6c6-a0e01a614c28/action => generated 0 bytes in 835 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 15:03:58.166104 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [req-bab06a05-7dd2-42f5-bd60-910a94bbc999 req-9a0755d5-81f5-45c9-93e3-ae97f60cd603 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40591370-dbd3-45b4-b6c6-a0e01a614c28", "tag": "6431ed44-bb34-4a76-bf6a-5f589562735a"}]} {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:03:58.167252 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-600d09bc-5cdd-49fe-b26a-f9d9eb207a73 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:03:58.167875 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-600d09bc-5cdd-49fe-b26a-f9d9eb207a73 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] [instance: 40591370-dbd3-45b4-b6c6-a0e01a614c28] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:03:58.173288 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 15:03:58.173288 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: warnings.warn(msg) May 26 15:03:58.185847 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-600d09bc-5cdd-49fe-b26a-f9d9eb207a73 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:58.186306 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-600d09bc-5cdd-49fe-b26a-f9d9eb207a73 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:58.187390 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-600d09bc-5cdd-49fe-b26a-f9d9eb207a73 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:58.187764 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-600d09bc-5cdd-49fe-b26a-f9d9eb207a73 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:58.197043 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [req-bab06a05-7dd2-42f5-bd60-910a94bbc999 req-9a0755d5-81f5-45c9-93e3-ae97f60cd603 service nova] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:58.197761 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [req-bab06a05-7dd2-42f5-bd60-910a94bbc999 req-9a0755d5-81f5-45c9-93e3-ae97f60cd603 service nova] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:58.239758 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.compute.server_external_events [req-bab06a05-7dd2-42f5-bd60-910a94bbc999 req-9a0755d5-81f5-45c9-93e3-ae97f60cd603 service nova] Creating event network-changed:6431ed44-bb34-4a76-bf6a-5f589562735a for instance 40591370-dbd3-45b4-b6c6-a0e01a614c28 on hv-cinder-78414 May 26 15:03:58.244810 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [req-bab06a05-7dd2-42f5-bd60-910a94bbc999 req-9a0755d5-81f5-45c9-93e3-ae97f60cd603 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082038 May 26 15:03:58.246018 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 499/959] 10.222.0.81 () {64 vars in 1318 bytes} [Wed May 26 15:03:58 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:03:58.331837 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-09ceb32d-ef3f-455c-b6dc-b86eaed504ff tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:03:58.332900 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-09ceb32d-ef3f-455c-b6dc-b86eaed504ff tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 757c7def-93df-481f-b40d-7115f4bbbefe] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:03:58.342661 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-09ceb32d-ef3f-455c-b6dc-b86eaed504ff tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:58.344025 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-09ceb32d-ef3f-455c-b6dc-b86eaed504ff tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:58.345181 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-09ceb32d-ef3f-455c-b6dc-b86eaed504ff tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:58.345870 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-09ceb32d-ef3f-455c-b6dc-b86eaed504ff tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:58.565357 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-09ceb32d-ef3f-455c-b6dc-b86eaed504ff tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:03:58.574413 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-09ceb32d-ef3f-455c-b6dc-b86eaed504ff tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:03:58.575934 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-09ceb32d-ef3f-455c-b6dc-b86eaed504ff tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:03:58.577085 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-09ceb32d-ef3f-455c-b6dc-b86eaed504ff tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe" status: 200 len: 1724 microversion: 2.20 time: 0.251240 May 26 15:03:58.578220 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 500/960] 10.222.0.81 () {60 vars in 1277 bytes} [Wed May 26 15:03:58 2021] GET /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe => generated 1724 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:03:58.580130 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-600d09bc-5cdd-49fe-b26a-f9d9eb207a73 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf31e2b7edd47c8835741c0dd03b7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83937b4f3831489289cd8aec97222f77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:03:58.591618 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-600d09bc-5cdd-49fe-b26a-f9d9eb207a73 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] 10.222.0.81 "GET /compute/v2.1/servers/40591370-dbd3-45b4-b6c6-a0e01a614c28" status: 200 len: 1758 microversion: 2.1 time: 0.433422 May 26 15:03:58.592398 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 461/961] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:03:58 2021] GET /compute/v2.1/servers/40591370-dbd3-45b4-b6c6-a0e01a614c28 => generated 1758 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:03:59.034060 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-f0f26dcf-6716-4f31-91bd-9300b7cbdb5b tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:03:59.034685 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-f0f26dcf-6716-4f31-91bd-9300b7cbdb5b tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] [instance: 29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:03:59.041923 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-f0f26dcf-6716-4f31-91bd-9300b7cbdb5b tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:59.042386 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-f0f26dcf-6716-4f31-91bd-9300b7cbdb5b tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:59.043175 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-f0f26dcf-6716-4f31-91bd-9300b7cbdb5b tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:59.043628 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-f0f26dcf-6716-4f31-91bd-9300b7cbdb5b tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:59.245482 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-f0f26dcf-6716-4f31-91bd-9300b7cbdb5b tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565618950dd54005a4a040f4dd0cbb33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c65d1e254f424ebfea8360aa697c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:03:59.253968 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-f0f26dcf-6716-4f31-91bd-9300b7cbdb5b tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /compute/v2.1/servers/29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de" status: 200 len: 1569 microversion: 2.1 time: 0.224120 May 26 15:03:59.254632 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 501/962] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:03:59 2021] GET /compute/v2.1/servers/29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de => generated 1569 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:03:59.596112 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-9104f7e4-760a-4815-a650-eddd473f344c tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:03:59.596736 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-9104f7e4-760a-4815-a650-eddd473f344c tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 757c7def-93df-481f-b40d-7115f4bbbefe] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:03:59.605715 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-9104f7e4-760a-4815-a650-eddd473f344c tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:59.606179 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-9104f7e4-760a-4815-a650-eddd473f344c tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:59.606967 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-9104f7e4-760a-4815-a650-eddd473f344c tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:03:59.607416 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-9104f7e4-760a-4815-a650-eddd473f344c tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:03:59.833067 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-9104f7e4-760a-4815-a650-eddd473f344c tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:03:59.841871 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-9104f7e4-760a-4815-a650-eddd473f344c tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:03:59.843391 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-9104f7e4-760a-4815-a650-eddd473f344c tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:03:59.844518 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-9104f7e4-760a-4815-a650-eddd473f344c tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe" status: 200 len: 1724 microversion: 2.20 time: 0.253102 May 26 15:03:59.845078 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 462/963] 10.222.0.81 () {60 vars in 1277 bytes} [Wed May 26 15:03:59 2021] GET /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe => generated 1724 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:04:00.271251 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-41dbc3e6-1985-43c0-a698-7e8d57031c01 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:04:00.271866 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-41dbc3e6-1985-43c0-a698-7e8d57031c01 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] [instance: 29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:04:00.279527 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-41dbc3e6-1985-43c0-a698-7e8d57031c01 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:00.279981 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-41dbc3e6-1985-43c0-a698-7e8d57031c01 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:00.280804 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-41dbc3e6-1985-43c0-a698-7e8d57031c01 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:00.281253 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-41dbc3e6-1985-43c0-a698-7e8d57031c01 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:00.477011 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-41dbc3e6-1985-43c0-a698-7e8d57031c01 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565618950dd54005a4a040f4dd0cbb33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c65d1e254f424ebfea8360aa697c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:04:00.485929 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-41dbc3e6-1985-43c0-a698-7e8d57031c01 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /compute/v2.1/servers/29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de" status: 200 len: 1569 microversion: 2.1 time: 0.218295 May 26 15:04:00.486488 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 502/964] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:04:00 2021] GET /compute/v2.1/servers/29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de => generated 1569 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:04:00.862593 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-704d5848-3f7a-4716-acc0-b3b4b734a280 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:04:00.863221 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-704d5848-3f7a-4716-acc0-b3b4b734a280 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 757c7def-93df-481f-b40d-7115f4bbbefe] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:04:00.870654 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-704d5848-3f7a-4716-acc0-b3b4b734a280 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:00.871114 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-704d5848-3f7a-4716-acc0-b3b4b734a280 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:00.871898 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-704d5848-3f7a-4716-acc0-b3b4b734a280 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:00.872345 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-704d5848-3f7a-4716-acc0-b3b4b734a280 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:01.075734 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-704d5848-3f7a-4716-acc0-b3b4b734a280 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:04:01.085814 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-704d5848-3f7a-4716-acc0-b3b4b734a280 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:04:01.087264 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-704d5848-3f7a-4716-acc0-b3b4b734a280 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:04:01.088405 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-704d5848-3f7a-4716-acc0-b3b4b734a280 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe" status: 200 len: 1745 microversion: 2.20 time: 0.229766 May 26 15:04:01.088956 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 463/965] 10.222.0.81 () {60 vars in 1277 bytes} [Wed May 26 15:04:00 2021] GET /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe => generated 1745 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:04:01.503296 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-efd572a6-2021-493b-b3d3-fc2d38e4ec3a tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:04:01.503924 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-efd572a6-2021-493b-b3d3-fc2d38e4ec3a tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] [instance: 29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:04:01.511349 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-efd572a6-2021-493b-b3d3-fc2d38e4ec3a tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:01.511812 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-efd572a6-2021-493b-b3d3-fc2d38e4ec3a tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:01.512614 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-efd572a6-2021-493b-b3d3-fc2d38e4ec3a tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:01.513060 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-efd572a6-2021-493b-b3d3-fc2d38e4ec3a tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:01.718029 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-efd572a6-2021-493b-b3d3-fc2d38e4ec3a tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565618950dd54005a4a040f4dd0cbb33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c65d1e254f424ebfea8360aa697c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:04:01.726524 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-efd572a6-2021-493b-b3d3-fc2d38e4ec3a tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /compute/v2.1/servers/29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de" status: 200 len: 1569 microversion: 2.1 time: 0.227634 May 26 15:04:01.727091 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 503/966] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:04:01 2021] GET /compute/v2.1/servers/29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de => generated 1569 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:04:02.107881 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-ffd08500-a3ff-44b0-b604-1073dba6e95a tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:04:02.108512 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-ffd08500-a3ff-44b0-b604-1073dba6e95a tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 757c7def-93df-481f-b40d-7115f4bbbefe] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:04:02.116897 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-ffd08500-a3ff-44b0-b604-1073dba6e95a tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:02.117329 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-ffd08500-a3ff-44b0-b604-1073dba6e95a tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:02.118128 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-ffd08500-a3ff-44b0-b604-1073dba6e95a tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:02.118593 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-ffd08500-a3ff-44b0-b604-1073dba6e95a tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:02.332040 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-ffd08500-a3ff-44b0-b604-1073dba6e95a tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:04:02.340888 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-ffd08500-a3ff-44b0-b604-1073dba6e95a tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:04:02.342449 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-ffd08500-a3ff-44b0-b604-1073dba6e95a tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:04:02.344263 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-ffd08500-a3ff-44b0-b604-1073dba6e95a tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe" status: 200 len: 1745 microversion: 2.20 time: 0.240198 May 26 15:04:02.344838 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 464/967] 10.222.0.81 () {60 vars in 1277 bytes} [Wed May 26 15:04:02 2021] GET /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe => generated 1745 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:04:02.743842 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-ad110ba8-56bf-4714-8e17-62ec1e9eb560 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:04:02.744538 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-ad110ba8-56bf-4714-8e17-62ec1e9eb560 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] [instance: 29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:04:02.752675 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-ad110ba8-56bf-4714-8e17-62ec1e9eb560 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:02.753127 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-ad110ba8-56bf-4714-8e17-62ec1e9eb560 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:02.753938 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-ad110ba8-56bf-4714-8e17-62ec1e9eb560 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:02.754376 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-ad110ba8-56bf-4714-8e17-62ec1e9eb560 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:02.997722 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-ad110ba8-56bf-4714-8e17-62ec1e9eb560 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565618950dd54005a4a040f4dd0cbb33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c65d1e254f424ebfea8360aa697c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:04:03.009135 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-ad110ba8-56bf-4714-8e17-62ec1e9eb560 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /compute/v2.1/servers/29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de" status: 200 len: 1569 microversion: 2.1 time: 0.268611 May 26 15:04:03.010454 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 504/968] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:04:02 2021] GET /compute/v2.1/servers/29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de => generated 1569 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:04:03.276764 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [req-fe316c0c-5015-40ab-b780-ccd057b4304a req-87c8e957-6be6-4202-a635-1a94ac11a83c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "757c7def-93df-481f-b40d-7115f4bbbefe", "name": "network-vif-plugged", "status": "completed", "tag": "d9f82690-b757-4c6f-b288-d20d193f4031"}]} {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:04:03.278729 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 15:04:03.278729 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: warnings.warn(msg) May 26 15:04:03.288563 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [req-fe316c0c-5015-40ab-b780-ccd057b4304a req-87c8e957-6be6-4202-a635-1a94ac11a83c service nova] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:03.289018 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [req-fe316c0c-5015-40ab-b780-ccd057b4304a req-87c8e957-6be6-4202-a635-1a94ac11a83c service nova] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:03.308341 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.compute.server_external_events [req-fe316c0c-5015-40ab-b780-ccd057b4304a req-87c8e957-6be6-4202-a635-1a94ac11a83c service nova] Creating event network-vif-plugged:d9f82690-b757-4c6f-b288-d20d193f4031 for instance 757c7def-93df-481f-b40d-7115f4bbbefe on hv-cinder-78414 May 26 15:04:03.316113 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [req-fe316c0c-5015-40ab-b780-ccd057b4304a req-87c8e957-6be6-4202-a635-1a94ac11a83c service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044686 May 26 15:04:03.318644 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 465/969] 10.222.0.81 () {64 vars in 1318 bytes} [Wed May 26 15:04:03 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:04:03.363453 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-3bbe3b64-7f5f-4a86-8138-d76f60983af0 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:04:03.364960 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-3bbe3b64-7f5f-4a86-8138-d76f60983af0 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 757c7def-93df-481f-b40d-7115f4bbbefe] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:04:03.379629 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-3bbe3b64-7f5f-4a86-8138-d76f60983af0 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:03.384724 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-3bbe3b64-7f5f-4a86-8138-d76f60983af0 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:03.384724 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-3bbe3b64-7f5f-4a86-8138-d76f60983af0 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:03.384724 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-3bbe3b64-7f5f-4a86-8138-d76f60983af0 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:03.649803 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-3bbe3b64-7f5f-4a86-8138-d76f60983af0 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:04:03.660353 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-3bbe3b64-7f5f-4a86-8138-d76f60983af0 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:04:03.662464 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-3bbe3b64-7f5f-4a86-8138-d76f60983af0 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:04:03.663871 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-3bbe3b64-7f5f-4a86-8138-d76f60983af0 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe" status: 200 len: 1740 microversion: 2.20 time: 0.306018 May 26 15:04:03.664630 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 505/970] 10.222.0.81 () {60 vars in 1277 bytes} [Wed May 26 15:04:03 2021] GET /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe => generated 1740 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:04:04.028717 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-d2aeac81-1a19-4588-a26f-3221e202bc8e tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:04:04.031106 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-d2aeac81-1a19-4588-a26f-3221e202bc8e tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] [instance: 29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:04:04.040596 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-d2aeac81-1a19-4588-a26f-3221e202bc8e tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:04.041105 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-d2aeac81-1a19-4588-a26f-3221e202bc8e tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:04.042007 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-d2aeac81-1a19-4588-a26f-3221e202bc8e tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:04.042734 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-d2aeac81-1a19-4588-a26f-3221e202bc8e tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:04.325332 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-d2aeac81-1a19-4588-a26f-3221e202bc8e tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565618950dd54005a4a040f4dd0cbb33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c65d1e254f424ebfea8360aa697c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:04:04.337757 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-d2aeac81-1a19-4588-a26f-3221e202bc8e tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /compute/v2.1/servers/29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de" status: 200 len: 1569 microversion: 2.1 time: 0.313303 May 26 15:04:04.338459 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 466/971] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:04:04 2021] GET /compute/v2.1/servers/29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de => generated 1569 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:04:04.651939 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-970040b3-8445-4137-8ee6-2d4a1598836c tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:04:04.653032 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-970040b3-8445-4137-8ee6-2d4a1598836c tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: 7ad07221-7c50-403d-9d99-8f876d7b7c63] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:04:04.661778 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-970040b3-8445-4137-8ee6-2d4a1598836c tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:04.662539 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-970040b3-8445-4137-8ee6-2d4a1598836c tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:04.663558 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-970040b3-8445-4137-8ee6-2d4a1598836c tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:04.664089 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-970040b3-8445-4137-8ee6-2d4a1598836c tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:04.683365 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-974c188e-cafb-49b2-8bf6-d2782eb48287 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:04:04.684319 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-974c188e-cafb-49b2-8bf6-d2782eb48287 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 757c7def-93df-481f-b40d-7115f4bbbefe] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:04:04.706940 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-974c188e-cafb-49b2-8bf6-d2782eb48287 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:04.707901 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-974c188e-cafb-49b2-8bf6-d2782eb48287 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:04.709069 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-974c188e-cafb-49b2-8bf6-d2782eb48287 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:04.709727 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-974c188e-cafb-49b2-8bf6-d2782eb48287 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:04.770210 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-970040b3-8445-4137-8ee6-2d4a1598836c tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /compute/v2.1/servers/7ad07221-7c50-403d-9d99-8f876d7b7c63/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.123799 May 26 15:04:04.771714 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 506/972] 10.222.0.81 () {58 vars in 1302 bytes} [Wed May 26 15:04:04 2021] GET /compute/v2.1/servers/7ad07221-7c50-403d-9d99-8f876d7b7c63/os-volume_attachments => generated 197 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:04:04.782394 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-24a09245-7554-44bd-9657-033f0f03cb2e tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:04:04.783246 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-24a09245-7554-44bd-9657-033f0f03cb2e tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: 7ad07221-7c50-403d-9d99-8f876d7b7c63] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:04:04.791044 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-24a09245-7554-44bd-9657-033f0f03cb2e tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:04.792001 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-24a09245-7554-44bd-9657-033f0f03cb2e tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:04.805236 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-24a09245-7554-44bd-9657-033f0f03cb2e tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:04.806063 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-24a09245-7554-44bd-9657-033f0f03cb2e tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:04.878552 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-24a09245-7554-44bd-9657-033f0f03cb2e tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /compute/v2.1/servers/7ad07221-7c50-403d-9d99-8f876d7b7c63/os-volume_attachments/8b193835-40a9-49f2-aed9-699446ef0314" status: 200 len: 194 microversion: 2.1 time: 0.101016 May 26 15:04:04.885004 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 507/973] 10.222.0.81 () {58 vars in 1413 bytes} [Wed May 26 15:04:04 2021] GET /compute/v2.1/servers/7ad07221-7c50-403d-9d99-8f876d7b7c63/os-volume_attachments/8b193835-40a9-49f2-aed9-699446ef0314 => generated 194 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:04:04.949966 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-974c188e-cafb-49b2-8bf6-d2782eb48287 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:04:04.964922 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-974c188e-cafb-49b2-8bf6-d2782eb48287 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:04:04.966472 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-974c188e-cafb-49b2-8bf6-d2782eb48287 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:04:04.967720 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-974c188e-cafb-49b2-8bf6-d2782eb48287 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe" status: 200 len: 1740 microversion: 2.20 time: 0.288072 May 26 15:04:04.968840 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 467/974] 10.222.0.81 () {60 vars in 1277 bytes} [Wed May 26 15:04:04 2021] GET /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe => generated 1740 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:04:05.361928 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-4543e368-2f28-4755-9eff-00e9a6e2d5f2 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:04:05.362712 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-4543e368-2f28-4755-9eff-00e9a6e2d5f2 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] [instance: 29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:04:05.370568 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-4543e368-2f28-4755-9eff-00e9a6e2d5f2 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:05.371036 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-4543e368-2f28-4755-9eff-00e9a6e2d5f2 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:05.371838 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-4543e368-2f28-4755-9eff-00e9a6e2d5f2 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:05.372286 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-4543e368-2f28-4755-9eff-00e9a6e2d5f2 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:05.692676 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-4543e368-2f28-4755-9eff-00e9a6e2d5f2 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565618950dd54005a4a040f4dd0cbb33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c65d1e254f424ebfea8360aa697c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:04:05.703212 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-4543e368-2f28-4755-9eff-00e9a6e2d5f2 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /compute/v2.1/servers/29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de" status: 200 len: 1569 microversion: 2.1 time: 0.344829 May 26 15:04:05.707043 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 508/975] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:04:05 2021] GET /compute/v2.1/servers/29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de => generated 1569 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:04:05.995776 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-6ad6572f-1b94-4409-bc31-b77660ac8d38 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:04:05.996392 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-6ad6572f-1b94-4409-bc31-b77660ac8d38 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 757c7def-93df-481f-b40d-7115f4bbbefe] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:04:06.004585 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-6ad6572f-1b94-4409-bc31-b77660ac8d38 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:06.005074 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-6ad6572f-1b94-4409-bc31-b77660ac8d38 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:06.006152 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-6ad6572f-1b94-4409-bc31-b77660ac8d38 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:06.006686 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-6ad6572f-1b94-4409-bc31-b77660ac8d38 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:06.283089 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-6ad6572f-1b94-4409-bc31-b77660ac8d38 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:04:06.291824 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-6ad6572f-1b94-4409-bc31-b77660ac8d38 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:04:06.293331 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-6ad6572f-1b94-4409-bc31-b77660ac8d38 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:04:06.294505 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-6ad6572f-1b94-4409-bc31-b77660ac8d38 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe" status: 200 len: 1740 microversion: 2.20 time: 0.303560 May 26 15:04:06.298832 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 468/976] 10.222.0.81 () {60 vars in 1277 bytes} [Wed May 26 15:04:05 2021] GET /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe => generated 1740 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 15:04:06.721790 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-323197cd-4a90-4162-af2d-3ebb70848216 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:04:06.722764 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-323197cd-4a90-4162-af2d-3ebb70848216 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] [instance: 29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:04:06.730963 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-323197cd-4a90-4162-af2d-3ebb70848216 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:06.734184 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-323197cd-4a90-4162-af2d-3ebb70848216 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:06.736114 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-323197cd-4a90-4162-af2d-3ebb70848216 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:06.736941 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-323197cd-4a90-4162-af2d-3ebb70848216 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:06.791480 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-a6d430b8-3680-4f3f-992e-445391d57f0b tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "73d83ddf-ec52-4d5c-90d4-9af304377c5f"}} {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:04:06.793658 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-a6d430b8-3680-4f3f-992e-445391d57f0b tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: 7ad07221-7c50-403d-9d99-8f876d7b7c63] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:04:06.806968 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-a6d430b8-3680-4f3f-992e-445391d57f0b tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:06.806968 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-a6d430b8-3680-4f3f-992e-445391d57f0b tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:06.814382 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-a6d430b8-3680-4f3f-992e-445391d57f0b tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:06.824548 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-a6d430b8-3680-4f3f-992e-445391d57f0b tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:07.005411 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-323197cd-4a90-4162-af2d-3ebb70848216 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565618950dd54005a4a040f4dd0cbb33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c65d1e254f424ebfea8360aa697c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:04:07.018350 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-323197cd-4a90-4162-af2d-3ebb70848216 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /compute/v2.1/servers/29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de" status: 200 len: 1569 microversion: 2.1 time: 0.301353 May 26 15:04:07.030681 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 509/977] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:04:06 2021] GET /compute/v2.1/servers/29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de => generated 1569 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:04:07.314429 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-d1bad1c0-096a-48ee-b225-2cfc0a6501b9 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:04:07.315151 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-d1bad1c0-096a-48ee-b225-2cfc0a6501b9 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 757c7def-93df-481f-b40d-7115f4bbbefe] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:04:07.322892 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-d1bad1c0-096a-48ee-b225-2cfc0a6501b9 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:07.323593 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-d1bad1c0-096a-48ee-b225-2cfc0a6501b9 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:07.324542 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-d1bad1c0-096a-48ee-b225-2cfc0a6501b9 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:07.324990 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-d1bad1c0-096a-48ee-b225-2cfc0a6501b9 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:07.567863 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-d1bad1c0-096a-48ee-b225-2cfc0a6501b9 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:04:07.577844 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-d1bad1c0-096a-48ee-b225-2cfc0a6501b9 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:04:07.579946 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-d1bad1c0-096a-48ee-b225-2cfc0a6501b9 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:04:07.581237 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-d1bad1c0-096a-48ee-b225-2cfc0a6501b9 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe" status: 200 len: 1740 microversion: 2.20 time: 0.271055 May 26 15:04:07.591989 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 510/978] 10.222.0.81 () {60 vars in 1277 bytes} [Wed May 26 15:04:07 2021] GET /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe => generated 1740 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 15:04:07.873872 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-a6d430b8-3680-4f3f-992e-445391d57f0b tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "POST /compute/v2.1/servers/7ad07221-7c50-403d-9d99-8f876d7b7c63/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.085692 May 26 15:04:07.876483 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 469/979] 10.222.0.81 () {60 vars in 1323 bytes} [Wed May 26 15:04:06 2021] POST /compute/v2.1/servers/7ad07221-7c50-403d-9d99-8f876d7b7c63/os-volume_attachments => generated 194 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:04:08.039183 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-e97481d9-8ca3-4b65-8b10-f0db16f5e26d tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:04:08.040761 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-e97481d9-8ca3-4b65-8b10-f0db16f5e26d tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] [instance: 29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:04:08.051919 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-e97481d9-8ca3-4b65-8b10-f0db16f5e26d tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:08.052716 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-e97481d9-8ca3-4b65-8b10-f0db16f5e26d tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:08.054116 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-e97481d9-8ca3-4b65-8b10-f0db16f5e26d tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:08.054804 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-e97481d9-8ca3-4b65-8b10-f0db16f5e26d tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:08.270378 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-e97481d9-8ca3-4b65-8b10-f0db16f5e26d tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565618950dd54005a4a040f4dd0cbb33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c65d1e254f424ebfea8360aa697c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:04:08.279329 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-e97481d9-8ca3-4b65-8b10-f0db16f5e26d tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /compute/v2.1/servers/29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de" status: 200 len: 1510 microversion: 2.1 time: 0.246610 May 26 15:04:08.289759 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 511/980] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:04:08 2021] GET /compute/v2.1/servers/29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de => generated 1510 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:04:08.300739 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-db731c09-df7f-4d87-a155-6dfd49c00b96 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:04:08.301414 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-db731c09-df7f-4d87-a155-6dfd49c00b96 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] [instance: 29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:04:08.314492 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-db731c09-df7f-4d87-a155-6dfd49c00b96 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:08.314951 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-db731c09-df7f-4d87-a155-6dfd49c00b96 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:08.315750 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-db731c09-df7f-4d87-a155-6dfd49c00b96 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:08.316200 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-db731c09-df7f-4d87-a155-6dfd49c00b96 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:08.599780 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-e1ee7ee7-a8cd-401a-ab14-72053a1f1dbc tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:04:08.600406 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-e1ee7ee7-a8cd-401a-ab14-72053a1f1dbc tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 757c7def-93df-481f-b40d-7115f4bbbefe] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:04:08.611885 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-e1ee7ee7-a8cd-401a-ab14-72053a1f1dbc tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:08.612533 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-e1ee7ee7-a8cd-401a-ab14-72053a1f1dbc tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:08.613571 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-e1ee7ee7-a8cd-401a-ab14-72053a1f1dbc tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:08.614229 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-db731c09-df7f-4d87-a155-6dfd49c00b96 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "POST /compute/v2.1/servers/29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de/action" status: 202 len: 0 microversion: 2.1 time: 0.319231 May 26 15:04:08.615408 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 470/981] 10.222.0.81 () {60 vars in 1278 bytes} [Wed May 26 15:04:08 2021] POST /compute/v2.1/servers/29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de/action => generated 0 bytes in 322 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 15:04:08.615544 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-e1ee7ee7-a8cd-401a-ab14-72053a1f1dbc tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:08.630513 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-4d975673-cc47-4519-9025-189c41711a55 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:04:08.631412 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-4d975673-cc47-4519-9025-189c41711a55 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] [instance: 29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:04:08.647522 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-4d975673-cc47-4519-9025-189c41711a55 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:08.648265 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-4d975673-cc47-4519-9025-189c41711a55 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:08.649514 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-4d975673-cc47-4519-9025-189c41711a55 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:08.650007 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-4d975673-cc47-4519-9025-189c41711a55 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:09.141260 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-4d975673-cc47-4519-9025-189c41711a55 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565618950dd54005a4a040f4dd0cbb33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c65d1e254f424ebfea8360aa697c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:04:09.153029 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-4d975673-cc47-4519-9025-189c41711a55 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /compute/v2.1/servers/29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de" status: 200 len: 1518 microversion: 2.1 time: 0.526154 May 26 15:04:09.154949 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 471/982] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:04:08 2021] GET /compute/v2.1/servers/29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de => generated 1518 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:04:09.183354 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-e1ee7ee7-a8cd-401a-ab14-72053a1f1dbc tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:04:09.193490 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-e1ee7ee7-a8cd-401a-ab14-72053a1f1dbc tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:04:09.195049 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-e1ee7ee7-a8cd-401a-ab14-72053a1f1dbc tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:04:09.196387 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-e1ee7ee7-a8cd-401a-ab14-72053a1f1dbc tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe" status: 200 len: 1740 microversion: 2.20 time: 0.600354 May 26 15:04:09.197592 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 512/983] 10.222.0.81 () {60 vars in 1277 bytes} [Wed May 26 15:04:08 2021] GET /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe => generated 1740 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 15:04:09.229039 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [req-ebb7e3be-f7fd-4b60-9804-8c2cf46d2afd req-94c2eae6-7700-421d-84a4-e71b5650c7d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de", "name": "network-vif-unplugged", "status": "completed", "tag": "24388d3c-fd02-41f5-996a-da7452902c2b"}]} {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:04:09.230734 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 15:04:09.230734 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: warnings.warn(msg) May 26 15:04:09.240823 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [req-ebb7e3be-f7fd-4b60-9804-8c2cf46d2afd req-94c2eae6-7700-421d-84a4-e71b5650c7d4 service nova] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:09.240823 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [req-ebb7e3be-f7fd-4b60-9804-8c2cf46d2afd req-94c2eae6-7700-421d-84a4-e71b5650c7d4 service nova] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:09.257416 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.compute.server_external_events [req-ebb7e3be-f7fd-4b60-9804-8c2cf46d2afd req-94c2eae6-7700-421d-84a4-e71b5650c7d4 service nova] Unable to find a host for instance 29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de. Dropping event network-vif-unplugged {{(pid=118514) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} May 26 15:04:09.258347 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [req-ebb7e3be-f7fd-4b60-9804-8c2cf46d2afd req-94c2eae6-7700-421d-84a4-e71b5650c7d4 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.033582 May 26 15:04:09.259096 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 472/984] 10.222.0.81 () {64 vars in 1318 bytes} [Wed May 26 15:04:09 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 35 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) May 26 15:04:10.171616 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-ed0494e8-d8f6-4cb8-a6e7-cc3cc9a8648e tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:04:10.172585 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-ed0494e8-d8f6-4cb8-a6e7-cc3cc9a8648e tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] [instance: 29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:04:10.181194 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-ed0494e8-d8f6-4cb8-a6e7-cc3cc9a8648e tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:10.181590 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-ed0494e8-d8f6-4cb8-a6e7-cc3cc9a8648e tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:10.182583 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-ed0494e8-d8f6-4cb8-a6e7-cc3cc9a8648e tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:10.184764 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-ed0494e8-d8f6-4cb8-a6e7-cc3cc9a8648e tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:10.216556 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-83f3c619-c580-4211-83ac-162e55b2c807 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:04:10.217190 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-83f3c619-c580-4211-83ac-162e55b2c807 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 757c7def-93df-481f-b40d-7115f4bbbefe] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:04:10.235573 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-83f3c619-c580-4211-83ac-162e55b2c807 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:10.236261 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-83f3c619-c580-4211-83ac-162e55b2c807 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:10.240167 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-83f3c619-c580-4211-83ac-162e55b2c807 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:10.240660 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-83f3c619-c580-4211-83ac-162e55b2c807 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:10.494783 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-ed0494e8-d8f6-4cb8-a6e7-cc3cc9a8648e tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565618950dd54005a4a040f4dd0cbb33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c65d1e254f424ebfea8360aa697c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:04:10.500747 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-83f3c619-c580-4211-83ac-162e55b2c807 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:04:10.504252 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-ed0494e8-d8f6-4cb8-a6e7-cc3cc9a8648e tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /compute/v2.1/servers/29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de" status: 200 len: 1520 microversion: 2.1 time: 0.336486 May 26 15:04:10.505077 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 513/985] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:04:10 2021] GET /compute/v2.1/servers/29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de => generated 1520 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:04:10.521396 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-83f3c619-c580-4211-83ac-162e55b2c807 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:04:10.522988 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-83f3c619-c580-4211-83ac-162e55b2c807 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:04:10.524436 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-83f3c619-c580-4211-83ac-162e55b2c807 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe" status: 200 len: 1740 microversion: 2.20 time: 0.313402 May 26 15:04:10.535022 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 473/986] 10.222.0.81 () {60 vars in 1277 bytes} [Wed May 26 15:04:10 2021] GET /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe => generated 1740 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 15:04:11.522259 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-7bb7fac9-1c89-44ca-8d5d-970bbb60c137 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:04:11.523787 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-7bb7fac9-1c89-44ca-8d5d-970bbb60c137 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] [instance: 29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:04:11.537799 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-7bb7fac9-1c89-44ca-8d5d-970bbb60c137 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:11.538035 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-7bb7fac9-1c89-44ca-8d5d-970bbb60c137 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:11.538800 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-7bb7fac9-1c89-44ca-8d5d-970bbb60c137 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:11.539246 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-7bb7fac9-1c89-44ca-8d5d-970bbb60c137 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:11.543393 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-65ca3eb7-4b91-40db-9c62-0dd2b720367e tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:04:11.544381 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-65ca3eb7-4b91-40db-9c62-0dd2b720367e tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 757c7def-93df-481f-b40d-7115f4bbbefe] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:04:11.557140 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-65ca3eb7-4b91-40db-9c62-0dd2b720367e tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:11.557643 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-65ca3eb7-4b91-40db-9c62-0dd2b720367e tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:11.558463 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-65ca3eb7-4b91-40db-9c62-0dd2b720367e tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:11.558903 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-65ca3eb7-4b91-40db-9c62-0dd2b720367e tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:11.778971 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-7bb7fac9-1c89-44ca-8d5d-970bbb60c137 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565618950dd54005a4a040f4dd0cbb33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c65d1e254f424ebfea8360aa697c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:04:11.789685 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-7bb7fac9-1c89-44ca-8d5d-970bbb60c137 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /compute/v2.1/servers/29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de" status: 200 len: 1520 microversion: 2.1 time: 0.271249 May 26 15:04:11.793051 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 514/987] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:04:11 2021] GET /compute/v2.1/servers/29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de => generated 1520 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:04:11.822483 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-65ca3eb7-4b91-40db-9c62-0dd2b720367e tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:04:11.834686 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-65ca3eb7-4b91-40db-9c62-0dd2b720367e tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:04:11.836193 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-65ca3eb7-4b91-40db-9c62-0dd2b720367e tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:04:11.837363 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-65ca3eb7-4b91-40db-9c62-0dd2b720367e tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe" status: 200 len: 1740 microversion: 2.20 time: 0.297862 May 26 15:04:11.838273 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 474/988] 10.222.0.81 () {60 vars in 1277 bytes} [Wed May 26 15:04:11 2021] GET /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe => generated 1740 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:04:12.809208 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-d0185661-7004-4782-8f2b-60d727c87632 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:04:12.809779 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-d0185661-7004-4782-8f2b-60d727c87632 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] [instance: 29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:04:12.818265 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-d0185661-7004-4782-8f2b-60d727c87632 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:12.818576 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-d0185661-7004-4782-8f2b-60d727c87632 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:12.819356 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-d0185661-7004-4782-8f2b-60d727c87632 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:12.819797 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-d0185661-7004-4782-8f2b-60d727c87632 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:12.855656 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-ca59681d-6c32-4ee0-963b-e7285387baf7 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:04:12.856285 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-ca59681d-6c32-4ee0-963b-e7285387baf7 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 757c7def-93df-481f-b40d-7115f4bbbefe] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:04:12.864595 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-ca59681d-6c32-4ee0-963b-e7285387baf7 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:12.865038 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-ca59681d-6c32-4ee0-963b-e7285387baf7 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:12.865835 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-ca59681d-6c32-4ee0-963b-e7285387baf7 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:12.866276 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-ca59681d-6c32-4ee0-963b-e7285387baf7 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:13.027605 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-d0185661-7004-4782-8f2b-60d727c87632 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565618950dd54005a4a040f4dd0cbb33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c65d1e254f424ebfea8360aa697c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:04:13.037421 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-d0185661-7004-4782-8f2b-60d727c87632 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /compute/v2.1/servers/29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de" status: 200 len: 1520 microversion: 2.1 time: 0.231967 May 26 15:04:13.038239 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 515/989] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:04:12 2021] GET /compute/v2.1/servers/29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de => generated 1520 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:04:13.086592 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-ca59681d-6c32-4ee0-963b-e7285387baf7 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:04:13.096779 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-ca59681d-6c32-4ee0-963b-e7285387baf7 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:04:13.098454 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-ca59681d-6c32-4ee0-963b-e7285387baf7 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:04:13.099700 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-ca59681d-6c32-4ee0-963b-e7285387baf7 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe" status: 200 len: 1740 microversion: 2.20 time: 0.247827 May 26 15:04:13.110650 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 475/990] 10.222.0.81 () {60 vars in 1277 bytes} [Wed May 26 15:04:12 2021] GET /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe => generated 1740 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 15:04:14.055954 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-9faae0a8-82ae-4179-abb1-3735626afeec tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:04:14.056629 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-9faae0a8-82ae-4179-abb1-3735626afeec tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] [instance: 29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:04:14.065155 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-9faae0a8-82ae-4179-abb1-3735626afeec tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:14.065643 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-9faae0a8-82ae-4179-abb1-3735626afeec tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:14.066437 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-9faae0a8-82ae-4179-abb1-3735626afeec tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:14.067013 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-9faae0a8-82ae-4179-abb1-3735626afeec tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:14.117941 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-0916efa8-9135-442d-9536-e1cd100cf347 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:04:14.118554 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-0916efa8-9135-442d-9536-e1cd100cf347 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 757c7def-93df-481f-b40d-7115f4bbbefe] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:04:14.126537 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-0916efa8-9135-442d-9536-e1cd100cf347 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:14.127034 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-0916efa8-9135-442d-9536-e1cd100cf347 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:14.127866 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-0916efa8-9135-442d-9536-e1cd100cf347 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:14.128321 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-0916efa8-9135-442d-9536-e1cd100cf347 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:14.262637 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-9faae0a8-82ae-4179-abb1-3735626afeec tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565618950dd54005a4a040f4dd0cbb33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c65d1e254f424ebfea8360aa697c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:04:14.271539 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-9faae0a8-82ae-4179-abb1-3735626afeec tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /compute/v2.1/servers/29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de" status: 200 len: 1520 microversion: 2.1 time: 0.220299 May 26 15:04:14.272112 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 516/991] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:04:14 2021] GET /compute/v2.1/servers/29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de => generated 1520 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:04:14.331513 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-0916efa8-9135-442d-9536-e1cd100cf347 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:04:14.340305 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-0916efa8-9135-442d-9536-e1cd100cf347 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:04:14.341842 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-0916efa8-9135-442d-9536-e1cd100cf347 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:04:14.342970 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-0916efa8-9135-442d-9536-e1cd100cf347 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe" status: 200 len: 1740 microversion: 2.20 time: 0.228709 May 26 15:04:14.343992 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 476/992] 10.222.0.81 () {60 vars in 1277 bytes} [Wed May 26 15:04:14 2021] GET /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe => generated 1740 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:04:15.288149 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-3577a857-1b87-4ac8-ba9a-4004a8711f00 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:04:15.297115 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-3577a857-1b87-4ac8-ba9a-4004a8711f00 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] [instance: 29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:04:15.297115 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-3577a857-1b87-4ac8-ba9a-4004a8711f00 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:15.297115 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-3577a857-1b87-4ac8-ba9a-4004a8711f00 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:15.297659 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-3577a857-1b87-4ac8-ba9a-4004a8711f00 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:15.298047 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-3577a857-1b87-4ac8-ba9a-4004a8711f00 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:15.360916 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-0a67485f-0a33-410a-95e0-616c44a47942 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:04:15.362446 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-0a67485f-0a33-410a-95e0-616c44a47942 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 757c7def-93df-481f-b40d-7115f4bbbefe] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:04:15.370603 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-0a67485f-0a33-410a-95e0-616c44a47942 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:15.371322 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-0a67485f-0a33-410a-95e0-616c44a47942 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:15.372614 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-0a67485f-0a33-410a-95e0-616c44a47942 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:15.373282 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-0a67485f-0a33-410a-95e0-616c44a47942 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:15.523073 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-3577a857-1b87-4ac8-ba9a-4004a8711f00 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565618950dd54005a4a040f4dd0cbb33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c65d1e254f424ebfea8360aa697c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:04:15.532361 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-3577a857-1b87-4ac8-ba9a-4004a8711f00 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /compute/v2.1/servers/29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de" status: 200 len: 1520 microversion: 2.1 time: 0.247893 May 26 15:04:15.533178 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 517/993] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:04:15 2021] GET /compute/v2.1/servers/29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de => generated 1520 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:04:15.627121 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-95c342b4-143a-4424-abf7-77f77e5c1279 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:04:15.628098 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-95c342b4-143a-4424-abf7-77f77e5c1279 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] [instance: 40591370-dbd3-45b4-b6c6-a0e01a614c28] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:04:15.644507 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-95c342b4-143a-4424-abf7-77f77e5c1279 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:15.644975 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-95c342b4-143a-4424-abf7-77f77e5c1279 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:15.645835 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-95c342b4-143a-4424-abf7-77f77e5c1279 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:15.646282 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-95c342b4-143a-4424-abf7-77f77e5c1279 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:15.666207 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-0a67485f-0a33-410a-95e0-616c44a47942 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:04:15.675651 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-0a67485f-0a33-410a-95e0-616c44a47942 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:04:15.677161 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-0a67485f-0a33-410a-95e0-616c44a47942 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:04:15.678322 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-0a67485f-0a33-410a-95e0-616c44a47942 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe" status: 200 len: 1722 microversion: 2.20 time: 0.321981 May 26 15:04:15.678887 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 477/994] 10.222.0.81 () {60 vars in 1277 bytes} [Wed May 26 15:04:15 2021] GET /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe => generated 1722 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 15:04:15.832337 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-051f363a-d140-45c7-8929-6647e188c46c tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:04:15.833203 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-051f363a-d140-45c7-8929-6647e188c46c tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: 7ad07221-7c50-403d-9d99-8f876d7b7c63] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:04:15.840567 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-051f363a-d140-45c7-8929-6647e188c46c tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:15.841018 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-051f363a-d140-45c7-8929-6647e188c46c tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:15.841837 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-051f363a-d140-45c7-8929-6647e188c46c tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:15.842275 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-051f363a-d140-45c7-8929-6647e188c46c tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:15.905952 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-051f363a-d140-45c7-8929-6647e188c46c tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /compute/v2.1/servers/7ad07221-7c50-403d-9d99-8f876d7b7c63/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.077449 May 26 15:04:15.906513 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 478/995] 10.222.0.81 () {58 vars in 1302 bytes} [Wed May 26 15:04:15 2021] GET /compute/v2.1/servers/7ad07221-7c50-403d-9d99-8f876d7b7c63/os-volume_attachments => generated 371 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 15:04:15.942628 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-95c342b4-143a-4424-abf7-77f77e5c1279 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] 10.222.0.81 "POST /compute/v2.1/servers/40591370-dbd3-45b4-b6c6-a0e01a614c28/action" status: 202 len: 0 microversion: 2.1 time: 0.332867 May 26 15:04:15.943263 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 518/996] 10.222.0.81 () {60 vars in 1278 bytes} [Wed May 26 15:04:15 2021] POST /compute/v2.1/servers/40591370-dbd3-45b4-b6c6-a0e01a614c28/action => generated 0 bytes in 335 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 15:04:15.968054 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-f1b18263-3724-46e7-b87c-81f0ed29bc0c tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:04:15.968812 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-f1b18263-3724-46e7-b87c-81f0ed29bc0c tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] [instance: 40591370-dbd3-45b4-b6c6-a0e01a614c28] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:04:15.976522 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-f1b18263-3724-46e7-b87c-81f0ed29bc0c tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:15.976978 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-f1b18263-3724-46e7-b87c-81f0ed29bc0c tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:15.977789 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-f1b18263-3724-46e7-b87c-81f0ed29bc0c tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:15.978238 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-f1b18263-3724-46e7-b87c-81f0ed29bc0c tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:16.232262 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-d9596834-6e2d-4533-ab2c-be004d10a68f tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:04:16.232812 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-d9596834-6e2d-4533-ab2c-be004d10a68f tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: 7ad07221-7c50-403d-9d99-8f876d7b7c63] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:04:16.235490 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-f1b18263-3724-46e7-b87c-81f0ed29bc0c tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf31e2b7edd47c8835741c0dd03b7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83937b4f3831489289cd8aec97222f77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:04:16.241624 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-d9596834-6e2d-4533-ab2c-be004d10a68f tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:16.242318 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-d9596834-6e2d-4533-ab2c-be004d10a68f tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:16.243111 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-d9596834-6e2d-4533-ab2c-be004d10a68f tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:16.243724 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-d9596834-6e2d-4533-ab2c-be004d10a68f tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:16.246035 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-f1b18263-3724-46e7-b87c-81f0ed29bc0c tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] 10.222.0.81 "GET /compute/v2.1/servers/40591370-dbd3-45b4-b6c6-a0e01a614c28" status: 200 len: 1750 microversion: 2.1 time: 0.281648 May 26 15:04:16.250952 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 479/997] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:04:15 2021] GET /compute/v2.1/servers/40591370-dbd3-45b4-b6c6-a0e01a614c28 => generated 1750 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:04:16.308120 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-d9596834-6e2d-4533-ab2c-be004d10a68f tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /compute/v2.1/servers/7ad07221-7c50-403d-9d99-8f876d7b7c63/os-volume_attachments/8b193835-40a9-49f2-aed9-699446ef0314" status: 200 len: 194 microversion: 2.1 time: 0.080045 May 26 15:04:16.309028 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 519/998] 10.222.0.81 () {58 vars in 1413 bytes} [Wed May 26 15:04:16 2021] GET /compute/v2.1/servers/7ad07221-7c50-403d-9d99-8f876d7b7c63/os-volume_attachments/8b193835-40a9-49f2-aed9-699446ef0314 => generated 194 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 15:04:16.318448 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-1c019502-b637-4f70-9aa2-1587087fd04e tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:04:16.319036 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-1c019502-b637-4f70-9aa2-1587087fd04e tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: 7ad07221-7c50-403d-9d99-8f876d7b7c63] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:04:16.326219 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-1c019502-b637-4f70-9aa2-1587087fd04e tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:16.328770 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-1c019502-b637-4f70-9aa2-1587087fd04e tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:16.328770 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-1c019502-b637-4f70-9aa2-1587087fd04e tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:16.328770 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-1c019502-b637-4f70-9aa2-1587087fd04e tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:16.500180 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.objects.instance [None req-1c019502-b637-4f70-9aa2-1587087fd04e tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lazy-loading 'services' on Instance uuid 7ad07221-7c50-403d-9d99-8f876d7b7c63 {{(pid=118514) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 26 15:04:16.550438 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-94783651-3dc1-4214-b167-da296d2eeb70 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:04:16.551667 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-94783651-3dc1-4214-b167-da296d2eeb70 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] [instance: 29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:04:16.559873 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-94783651-3dc1-4214-b167-da296d2eeb70 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:16.561639 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-94783651-3dc1-4214-b167-da296d2eeb70 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:16.563264 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-94783651-3dc1-4214-b167-da296d2eeb70 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:16.563829 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-94783651-3dc1-4214-b167-da296d2eeb70 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:16.778919 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-1c019502-b637-4f70-9aa2-1587087fd04e tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "DELETE /compute/v2.1/servers/7ad07221-7c50-403d-9d99-8f876d7b7c63/os-volume_attachments/8b193835-40a9-49f2-aed9-699446ef0314" status: 202 len: 0 microversion: 2.1 time: 0.463827 May 26 15:04:16.779100 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-94783651-3dc1-4214-b167-da296d2eeb70 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565618950dd54005a4a040f4dd0cbb33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c65d1e254f424ebfea8360aa697c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:04:16.781758 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 480/999] 10.222.0.81 () {58 vars in 1416 bytes} [Wed May 26 15:04:16 2021] DELETE /compute/v2.1/servers/7ad07221-7c50-403d-9d99-8f876d7b7c63/os-volume_attachments/8b193835-40a9-49f2-aed9-699446ef0314 => generated 0 bytes in 466 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 26 15:04:16.786220 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-9fbbb2a3-0887-4ef1-80a4-ad1e46fa1a5e tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:04:16.791404 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-94783651-3dc1-4214-b167-da296d2eeb70 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /compute/v2.1/servers/29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de" status: 200 len: 1520 microversion: 2.1 time: 0.244955 May 26 15:04:16.793906 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-9fbbb2a3-0887-4ef1-80a4-ad1e46fa1a5e tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 757c7def-93df-481f-b40d-7115f4bbbefe] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:04:16.803088 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 520/1000] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:04:16 2021] GET /compute/v2.1/servers/29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de => generated 1520 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:04:16.808123 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-9fbbb2a3-0887-4ef1-80a4-ad1e46fa1a5e tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:16.809043 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-9fbbb2a3-0887-4ef1-80a4-ad1e46fa1a5e tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:16.810031 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-9fbbb2a3-0887-4ef1-80a4-ad1e46fa1a5e tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:16.810546 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-9fbbb2a3-0887-4ef1-80a4-ad1e46fa1a5e tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:17.086754 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-9fbbb2a3-0887-4ef1-80a4-ad1e46fa1a5e tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:04:17.097212 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-9fbbb2a3-0887-4ef1-80a4-ad1e46fa1a5e tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:04:17.098810 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-9fbbb2a3-0887-4ef1-80a4-ad1e46fa1a5e tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:04:17.099961 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-9fbbb2a3-0887-4ef1-80a4-ad1e46fa1a5e tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe" status: 200 len: 1722 microversion: 2.20 time: 0.318806 May 26 15:04:17.100524 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 481/1001] 10.222.0.81 () {60 vars in 1277 bytes} [Wed May 26 15:04:16 2021] GET /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe => generated 1722 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:04:17.165708 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [req-15ffa4af-87d0-4de5-b8f7-a26266fb56ef req-0a6e4c27-778b-4eb0-8cfb-2438f9162699 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "757c7def-93df-481f-b40d-7115f4bbbefe", "name": "network-vif-unplugged", "status": "completed", "tag": "d9f82690-b757-4c6f-b288-d20d193f4031"}]} {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:04:17.167246 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 15:04:17.167246 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: warnings.warn(msg) May 26 15:04:17.176317 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [req-15ffa4af-87d0-4de5-b8f7-a26266fb56ef req-0a6e4c27-778b-4eb0-8cfb-2438f9162699 service nova] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:17.176769 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [req-15ffa4af-87d0-4de5-b8f7-a26266fb56ef req-0a6e4c27-778b-4eb0-8cfb-2438f9162699 service nova] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:17.192809 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.compute.server_external_events [req-15ffa4af-87d0-4de5-b8f7-a26266fb56ef req-0a6e4c27-778b-4eb0-8cfb-2438f9162699 service nova] Creating event network-vif-unplugged:d9f82690-b757-4c6f-b288-d20d193f4031 for instance 757c7def-93df-481f-b40d-7115f4bbbefe on hv-cinder-78414 May 26 15:04:17.197692 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [req-15ffa4af-87d0-4de5-b8f7-a26266fb56ef req-0a6e4c27-778b-4eb0-8cfb-2438f9162699 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035934 May 26 15:04:17.198376 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 521/1002] 10.222.0.81 () {64 vars in 1318 bytes} [Wed May 26 15:04:17 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:04:17.266136 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-d5908986-8f86-45ef-bdaa-f1137c7c5808 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:04:17.266942 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-d5908986-8f86-45ef-bdaa-f1137c7c5808 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] [instance: 40591370-dbd3-45b4-b6c6-a0e01a614c28] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:04:17.274748 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-d5908986-8f86-45ef-bdaa-f1137c7c5808 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:17.275208 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-d5908986-8f86-45ef-bdaa-f1137c7c5808 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:17.276194 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-d5908986-8f86-45ef-bdaa-f1137c7c5808 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:17.276678 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-d5908986-8f86-45ef-bdaa-f1137c7c5808 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:17.481574 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-d5908986-8f86-45ef-bdaa-f1137c7c5808 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf31e2b7edd47c8835741c0dd03b7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83937b4f3831489289cd8aec97222f77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:04:17.490350 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-d5908986-8f86-45ef-bdaa-f1137c7c5808 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] 10.222.0.81 "GET /compute/v2.1/servers/40591370-dbd3-45b4-b6c6-a0e01a614c28" status: 200 len: 1755 microversion: 2.1 time: 0.228685 May 26 15:04:17.490919 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 482/1003] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:04:17 2021] GET /compute/v2.1/servers/40591370-dbd3-45b4-b6c6-a0e01a614c28 => generated 1755 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:04:17.808749 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-93771bc3-644d-4a1d-8973-e53844576f28 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:04:17.809602 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-93771bc3-644d-4a1d-8973-e53844576f28 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] [instance: 29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:04:17.818377 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-93771bc3-644d-4a1d-8973-e53844576f28 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:17.818952 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-93771bc3-644d-4a1d-8973-e53844576f28 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:17.819846 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-93771bc3-644d-4a1d-8973-e53844576f28 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:17.820420 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-93771bc3-644d-4a1d-8973-e53844576f28 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:18.032836 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-93771bc3-644d-4a1d-8973-e53844576f28 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565618950dd54005a4a040f4dd0cbb33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c65d1e254f424ebfea8360aa697c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:04:18.041212 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-93771bc3-644d-4a1d-8973-e53844576f28 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /compute/v2.1/servers/29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de" status: 200 len: 1576 microversion: 2.1 time: 0.236851 May 26 15:04:18.041826 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 522/1004] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:04:17 2021] GET /compute/v2.1/servers/29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de => generated 1576 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:04:18.119021 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-c159e281-2874-49a6-84d3-20ff19d64ddf tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:04:18.119558 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-c159e281-2874-49a6-84d3-20ff19d64ddf tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 757c7def-93df-481f-b40d-7115f4bbbefe] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:04:18.128611 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-c159e281-2874-49a6-84d3-20ff19d64ddf tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:18.129067 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-c159e281-2874-49a6-84d3-20ff19d64ddf tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:18.129886 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-c159e281-2874-49a6-84d3-20ff19d64ddf tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:18.130329 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-c159e281-2874-49a6-84d3-20ff19d64ddf tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:18.470684 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-c159e281-2874-49a6-84d3-20ff19d64ddf tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:04:18.479604 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-c159e281-2874-49a6-84d3-20ff19d64ddf tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:04:18.481139 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-c159e281-2874-49a6-84d3-20ff19d64ddf tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:04:18.482500 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-c159e281-2874-49a6-84d3-20ff19d64ddf tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe" status: 200 len: 1725 microversion: 2.20 time: 0.367405 May 26 15:04:18.483287 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 483/1005] 10.222.0.81 () {60 vars in 1277 bytes} [Wed May 26 15:04:18 2021] GET /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe => generated 1725 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:04:18.502685 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-fd32c72f-e36b-4cc6-b491-c1a3ff2d03c4 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7988474e-d6a6-4c3b-8bd6-0401d429ea86"}} {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:04:18.502685 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-fd32c72f-e36b-4cc6-b491-c1a3ff2d03c4 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 757c7def-93df-481f-b40d-7115f4bbbefe] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:04:18.511264 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-cce10a85-306d-40af-a166-08843099569e tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:04:18.511885 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-cce10a85-306d-40af-a166-08843099569e tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] [instance: 40591370-dbd3-45b4-b6c6-a0e01a614c28] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:04:18.519536 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-fd32c72f-e36b-4cc6-b491-c1a3ff2d03c4 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:18.519997 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-fd32c72f-e36b-4cc6-b491-c1a3ff2d03c4 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:18.520788 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-fd32c72f-e36b-4cc6-b491-c1a3ff2d03c4 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:18.521231 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-fd32c72f-e36b-4cc6-b491-c1a3ff2d03c4 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:18.534026 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-cce10a85-306d-40af-a166-08843099569e tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:18.534486 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-cce10a85-306d-40af-a166-08843099569e tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:18.535324 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-cce10a85-306d-40af-a166-08843099569e tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:18.535766 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-cce10a85-306d-40af-a166-08843099569e tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:18.780347 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-cce10a85-306d-40af-a166-08843099569e tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf31e2b7edd47c8835741c0dd03b7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83937b4f3831489289cd8aec97222f77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:04:18.790186 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-cce10a85-306d-40af-a166-08843099569e tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] 10.222.0.81 "GET /compute/v2.1/servers/40591370-dbd3-45b4-b6c6-a0e01a614c28" status: 200 len: 1755 microversion: 2.1 time: 0.282510 May 26 15:04:18.793703 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 484/1006] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:04:18 2021] GET /compute/v2.1/servers/40591370-dbd3-45b4-b6c6-a0e01a614c28 => generated 1755 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:04:19.059275 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-1ae395e2-29ac-4a75-a03e-610a36dd0214 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:04:19.059929 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-1ae395e2-29ac-4a75-a03e-610a36dd0214 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] [instance: 29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:04:19.067488 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-1ae395e2-29ac-4a75-a03e-610a36dd0214 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:19.067951 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-1ae395e2-29ac-4a75-a03e-610a36dd0214 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:19.068740 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-1ae395e2-29ac-4a75-a03e-610a36dd0214 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:19.069181 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-1ae395e2-29ac-4a75-a03e-610a36dd0214 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:19.268263 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-1ae395e2-29ac-4a75-a03e-610a36dd0214 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565618950dd54005a4a040f4dd0cbb33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c65d1e254f424ebfea8360aa697c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:04:19.277168 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-1ae395e2-29ac-4a75-a03e-610a36dd0214 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /compute/v2.1/servers/29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de" status: 200 len: 1576 microversion: 2.1 time: 0.222203 May 26 15:04:19.277771 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 485/1007] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:04:19 2021] GET /compute/v2.1/servers/29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de => generated 1576 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:04:19.282251 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-a01a20f8-011c-4ae6-a35e-3d5fdf823b7e tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:04:19.282745 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-a01a20f8-011c-4ae6-a35e-3d5fdf823b7e tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: 7ad07221-7c50-403d-9d99-8f876d7b7c63] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:04:19.289759 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-a01a20f8-011c-4ae6-a35e-3d5fdf823b7e tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:19.290211 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-a01a20f8-011c-4ae6-a35e-3d5fdf823b7e tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:19.290976 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-a01a20f8-011c-4ae6-a35e-3d5fdf823b7e tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:19.291410 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-a01a20f8-011c-4ae6-a35e-3d5fdf823b7e tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:19.355419 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-a01a20f8-011c-4ae6-a35e-3d5fdf823b7e tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /compute/v2.1/servers/7ad07221-7c50-403d-9d99-8f876d7b7c63/os-volume_attachments/73d83ddf-ec52-4d5c-90d4-9af304377c5f" status: 200 len: 194 microversion: 2.1 time: 0.076600 May 26 15:04:19.356016 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 486/1008] 10.222.0.81 () {58 vars in 1413 bytes} [Wed May 26 15:04:19 2021] GET /compute/v2.1/servers/7ad07221-7c50-403d-9d99-8f876d7b7c63/os-volume_attachments/73d83ddf-ec52-4d5c-90d4-9af304377c5f => generated 194 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:04:19.365456 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-67b7df83-f558-4c02-aa3e-648ad64c9fc2 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:04:19.366026 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-67b7df83-f558-4c02-aa3e-648ad64c9fc2 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: 7ad07221-7c50-403d-9d99-8f876d7b7c63] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:04:19.373194 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-67b7df83-f558-4c02-aa3e-648ad64c9fc2 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:19.373686 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-67b7df83-f558-4c02-aa3e-648ad64c9fc2 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:19.374467 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-67b7df83-f558-4c02-aa3e-648ad64c9fc2 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:19.374912 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-67b7df83-f558-4c02-aa3e-648ad64c9fc2 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:19.535461 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.objects.instance [None req-67b7df83-f558-4c02-aa3e-648ad64c9fc2 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lazy-loading 'services' on Instance uuid 7ad07221-7c50-403d-9d99-8f876d7b7c63 {{(pid=118514) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 26 15:04:19.634962 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-fd32c72f-e36b-4cc6-b491-c1a3ff2d03c4 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "POST /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.137949 May 26 15:04:19.635683 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 523/1009] 10.222.0.81 () {62 vars in 1364 bytes} [Wed May 26 15:04:18 2021] POST /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe/os-volume_attachments => generated 188 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 15:04:19.739821 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-f5dc32d9-990a-4c53-84fe-923d0d86b918 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:04:19.740322 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-f5dc32d9-990a-4c53-84fe-923d0d86b918 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 757c7def-93df-481f-b40d-7115f4bbbefe] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:04:19.749427 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-f5dc32d9-990a-4c53-84fe-923d0d86b918 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:19.749427 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-f5dc32d9-990a-4c53-84fe-923d0d86b918 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:19.749427 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-f5dc32d9-990a-4c53-84fe-923d0d86b918 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:19.749427 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-f5dc32d9-990a-4c53-84fe-923d0d86b918 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:19.788840 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-67b7df83-f558-4c02-aa3e-648ad64c9fc2 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "DELETE /compute/v2.1/servers/7ad07221-7c50-403d-9d99-8f876d7b7c63/os-volume_attachments/73d83ddf-ec52-4d5c-90d4-9af304377c5f" status: 202 len: 0 microversion: 2.1 time: 0.426651 May 26 15:04:19.789351 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 487/1010] 10.222.0.81 () {58 vars in 1416 bytes} [Wed May 26 15:04:19 2021] DELETE /compute/v2.1/servers/7ad07221-7c50-403d-9d99-8f876d7b7c63/os-volume_attachments/73d83ddf-ec52-4d5c-90d4-9af304377c5f => generated 0 bytes in 428 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 26 15:04:19.808855 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-929df4cb-08d5-4881-b64c-5c0073b53d0e tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:04:19.809966 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-929df4cb-08d5-4881-b64c-5c0073b53d0e tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] [instance: 40591370-dbd3-45b4-b6c6-a0e01a614c28] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:04:19.818258 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-929df4cb-08d5-4881-b64c-5c0073b53d0e tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:19.818888 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-929df4cb-08d5-4881-b64c-5c0073b53d0e tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:19.819713 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-929df4cb-08d5-4881-b64c-5c0073b53d0e tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:19.820555 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-929df4cb-08d5-4881-b64c-5c0073b53d0e tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:20.035464 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-929df4cb-08d5-4881-b64c-5c0073b53d0e tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf31e2b7edd47c8835741c0dd03b7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83937b4f3831489289cd8aec97222f77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:04:20.045566 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-929df4cb-08d5-4881-b64c-5c0073b53d0e tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] 10.222.0.81 "GET /compute/v2.1/servers/40591370-dbd3-45b4-b6c6-a0e01a614c28" status: 200 len: 1755 microversion: 2.1 time: 0.240588 May 26 15:04:20.046075 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 488/1011] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:04:19 2021] GET /compute/v2.1/servers/40591370-dbd3-45b4-b6c6-a0e01a614c28 => generated 1755 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:04:20.293698 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-b78bb1f1-60d6-4876-889f-d6cd2b6a179b tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:04:20.294343 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-b78bb1f1-60d6-4876-889f-d6cd2b6a179b tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] [instance: 29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:04:20.302393 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-b78bb1f1-60d6-4876-889f-d6cd2b6a179b tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:20.302780 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-b78bb1f1-60d6-4876-889f-d6cd2b6a179b tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:20.303573 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-b78bb1f1-60d6-4876-889f-d6cd2b6a179b tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:20.304017 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-b78bb1f1-60d6-4876-889f-d6cd2b6a179b tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:20.497273 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-f5dc32d9-990a-4c53-84fe-923d0d86b918 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "DELETE /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe/os-volume_attachments/7988474e-d6a6-4c3b-8bd6-0401d429ea86" status: 202 len: 0 microversion: 2.20 time: 0.761188 May 26 15:04:20.497924 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 524/1012] 10.222.0.81 () {60 vars in 1457 bytes} [Wed May 26 15:04:19 2021] DELETE /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe/os-volume_attachments/7988474e-d6a6-4c3b-8bd6-0401d429ea86 => generated 0 bytes in 763 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) May 26 15:04:20.520715 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-b78bb1f1-60d6-4876-889f-d6cd2b6a179b tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565618950dd54005a4a040f4dd0cbb33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c65d1e254f424ebfea8360aa697c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:04:20.529295 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-b78bb1f1-60d6-4876-889f-d6cd2b6a179b tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /compute/v2.1/servers/29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de" status: 200 len: 1576 microversion: 2.1 time: 0.239242 May 26 15:04:20.529925 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 489/1013] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:04:20 2021] GET /compute/v2.1/servers/29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de => generated 1576 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:04:20.603363 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-d146a466-2bfd-4bfd-9c9f-2b59a76b9ad7 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:04:20.603972 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-d146a466-2bfd-4bfd-9c9f-2b59a76b9ad7 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 757c7def-93df-481f-b40d-7115f4bbbefe] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:04:20.611323 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-d146a466-2bfd-4bfd-9c9f-2b59a76b9ad7 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:20.611783 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-d146a466-2bfd-4bfd-9c9f-2b59a76b9ad7 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:20.612564 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-d146a466-2bfd-4bfd-9c9f-2b59a76b9ad7 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:20.613011 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-d146a466-2bfd-4bfd-9c9f-2b59a76b9ad7 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:20.876862 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-d146a466-2bfd-4bfd-9c9f-2b59a76b9ad7 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "POST /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe/action" status: 202 len: 0 microversion: 2.20 time: 0.277216 May 26 15:04:20.877757 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 525/1014] 10.222.0.81 () {62 vars in 1319 bytes} [Wed May 26 15:04:20 2021] POST /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe/action => generated 0 bytes in 279 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 26 15:04:20.885627 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-8df9894c-8e32-4977-b56c-023d39a7a292 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:04:20.886245 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-8df9894c-8e32-4977-b56c-023d39a7a292 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 757c7def-93df-481f-b40d-7115f4bbbefe] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:04:20.894206 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-8df9894c-8e32-4977-b56c-023d39a7a292 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:20.899814 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-8df9894c-8e32-4977-b56c-023d39a7a292 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:20.899814 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-8df9894c-8e32-4977-b56c-023d39a7a292 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:20.899814 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-8df9894c-8e32-4977-b56c-023d39a7a292 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:21.066606 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-d2c12c07-d96c-431f-ad1d-cb747e37ca7a tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:04:21.068443 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-d2c12c07-d96c-431f-ad1d-cb747e37ca7a tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] [instance: 40591370-dbd3-45b4-b6c6-a0e01a614c28] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:04:21.076581 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-d2c12c07-d96c-431f-ad1d-cb747e37ca7a tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:21.077389 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-d2c12c07-d96c-431f-ad1d-cb747e37ca7a tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:21.079349 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-d2c12c07-d96c-431f-ad1d-cb747e37ca7a tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:21.080379 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-d2c12c07-d96c-431f-ad1d-cb747e37ca7a tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:21.159220 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-8df9894c-8e32-4977-b56c-023d39a7a292 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:04:21.174494 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-8df9894c-8e32-4977-b56c-023d39a7a292 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:04:21.176379 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-8df9894c-8e32-4977-b56c-023d39a7a292 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:04:21.177742 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-8df9894c-8e32-4977-b56c-023d39a7a292 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe" status: 200 len: 1673 microversion: 2.20 time: 0.295896 May 26 15:04:21.180694 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 490/1015] 10.222.0.81 () {60 vars in 1277 bytes} [Wed May 26 15:04:20 2021] GET /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe => generated 1673 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:04:21.333590 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-d2c12c07-d96c-431f-ad1d-cb747e37ca7a tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf31e2b7edd47c8835741c0dd03b7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83937b4f3831489289cd8aec97222f77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:04:21.340461 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-d2c12c07-d96c-431f-ad1d-cb747e37ca7a tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] 10.222.0.81 "GET /compute/v2.1/servers/40591370-dbd3-45b4-b6c6-a0e01a614c28" status: 200 len: 1755 microversion: 2.1 time: 0.280313 May 26 15:04:21.341035 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 526/1016] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:04:21 2021] GET /compute/v2.1/servers/40591370-dbd3-45b4-b6c6-a0e01a614c28 => generated 1755 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:04:21.406277 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-b6ca5e71-55f3-4ae8-ad5f-7c8e2706e86f tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:04:21.406814 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-b6ca5e71-55f3-4ae8-ad5f-7c8e2706e86f tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: 7ad07221-7c50-403d-9d99-8f876d7b7c63] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:04:21.413864 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-b6ca5e71-55f3-4ae8-ad5f-7c8e2706e86f tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:21.414313 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-b6ca5e71-55f3-4ae8-ad5f-7c8e2706e86f tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:21.415087 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-b6ca5e71-55f3-4ae8-ad5f-7c8e2706e86f tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:21.415526 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-b6ca5e71-55f3-4ae8-ad5f-7c8e2706e86f tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:21.476088 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-b6ca5e71-55f3-4ae8-ad5f-7c8e2706e86f tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: 7ad07221-7c50-403d-9d99-8f876d7b7c63] Going to try to terminate instance {{(pid=118514) delete /opt/stack/nova/nova/compute/api.py:2539}} May 26 15:04:21.546502 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-e204e26f-e7ff-4d14-8ed2-1f2713d70b98 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:04:21.547399 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-e204e26f-e7ff-4d14-8ed2-1f2713d70b98 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] [instance: 29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:04:21.555193 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-e204e26f-e7ff-4d14-8ed2-1f2713d70b98 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:21.555805 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-e204e26f-e7ff-4d14-8ed2-1f2713d70b98 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:21.556710 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-e204e26f-e7ff-4d14-8ed2-1f2713d70b98 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:21.557223 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-e204e26f-e7ff-4d14-8ed2-1f2713d70b98 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:21.743828 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-b6ca5e71-55f3-4ae8-ad5f-7c8e2706e86f tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "DELETE /compute/v2.1/servers/7ad07221-7c50-403d-9d99-8f876d7b7c63" status: 204 len: 0 microversion: 2.1 time: 0.341019 May 26 15:04:21.752005 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 491/1017] 10.222.0.81 () {58 vars in 1239 bytes} [Wed May 26 15:04:21 2021] DELETE /compute/v2.1/servers/7ad07221-7c50-403d-9d99-8f876d7b7c63 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 15:04:21.754506 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-e4124b4f-ea88-4fc2-ad14-61681f68d722 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:04:21.755965 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-e4124b4f-ea88-4fc2-ad14-61681f68d722 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: 7ad07221-7c50-403d-9d99-8f876d7b7c63] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:04:21.769715 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-e4124b4f-ea88-4fc2-ad14-61681f68d722 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:21.770314 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-e4124b4f-ea88-4fc2-ad14-61681f68d722 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:21.771198 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-e4124b4f-ea88-4fc2-ad14-61681f68d722 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:21.771806 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-e4124b4f-ea88-4fc2-ad14-61681f68d722 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:21.778509 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-e204e26f-e7ff-4d14-8ed2-1f2713d70b98 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565618950dd54005a4a040f4dd0cbb33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c65d1e254f424ebfea8360aa697c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:04:21.788565 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-e204e26f-e7ff-4d14-8ed2-1f2713d70b98 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /compute/v2.1/servers/29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de" status: 200 len: 1576 microversion: 2.1 time: 0.245807 May 26 15:04:21.793836 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 527/1018] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:04:21 2021] GET /compute/v2.1/servers/29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de => generated 1576 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:04:21.988979 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-e4124b4f-ea88-4fc2-ad14-61681f68d722 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c2fb208b56d4d52b59ac09873f16180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e8cac36a174b2eb5a6e53fdf25b4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:04:21.998062 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-e4124b4f-ea88-4fc2-ad14-61681f68d722 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /compute/v2.1/servers/7ad07221-7c50-403d-9d99-8f876d7b7c63" status: 200 len: 1673 microversion: 2.1 time: 0.248862 May 26 15:04:22.008501 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 492/1019] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:04:21 2021] GET /compute/v2.1/servers/7ad07221-7c50-403d-9d99-8f876d7b7c63 => generated 1673 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:04:22.198163 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-32ecda1e-689e-4219-829e-c108e7601fe9 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:04:22.198698 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-32ecda1e-689e-4219-829e-c108e7601fe9 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 757c7def-93df-481f-b40d-7115f4bbbefe] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:04:22.205993 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-32ecda1e-689e-4219-829e-c108e7601fe9 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:22.206459 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-32ecda1e-689e-4219-829e-c108e7601fe9 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:22.207241 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-32ecda1e-689e-4219-829e-c108e7601fe9 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:22.207690 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-32ecda1e-689e-4219-829e-c108e7601fe9 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:22.358078 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-0b009638-ba2a-4557-839b-383a71587ec0 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:04:22.359065 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-0b009638-ba2a-4557-839b-383a71587ec0 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] [instance: 40591370-dbd3-45b4-b6c6-a0e01a614c28] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:04:22.367753 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-0b009638-ba2a-4557-839b-383a71587ec0 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:22.373089 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-0b009638-ba2a-4557-839b-383a71587ec0 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:22.373089 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-0b009638-ba2a-4557-839b-383a71587ec0 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:22.373089 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-0b009638-ba2a-4557-839b-383a71587ec0 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:22.410485 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-32ecda1e-689e-4219-829e-c108e7601fe9 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:04:22.419129 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-32ecda1e-689e-4219-829e-c108e7601fe9 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:04:22.423028 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-32ecda1e-689e-4219-829e-c108e7601fe9 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:04:22.423028 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-32ecda1e-689e-4219-829e-c108e7601fe9 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe" status: 200 len: 1673 microversion: 2.20 time: 0.227579 May 26 15:04:22.423587 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 528/1020] 10.222.0.81 () {60 vars in 1277 bytes} [Wed May 26 15:04:22 2021] GET /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe => generated 1673 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:04:22.573278 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-0b009638-ba2a-4557-839b-383a71587ec0 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf31e2b7edd47c8835741c0dd03b7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83937b4f3831489289cd8aec97222f77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:04:22.583224 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-0b009638-ba2a-4557-839b-383a71587ec0 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] 10.222.0.81 "GET /compute/v2.1/servers/40591370-dbd3-45b4-b6c6-a0e01a614c28" status: 200 len: 1755 microversion: 2.1 time: 0.228823 May 26 15:04:22.583795 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 493/1021] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:04:22 2021] GET /compute/v2.1/servers/40591370-dbd3-45b4-b6c6-a0e01a614c28 => generated 1755 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:04:22.806779 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-7894e6fd-f9c7-4e2d-9758-268d3b4e3206 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:04:22.807311 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-7894e6fd-f9c7-4e2d-9758-268d3b4e3206 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] [instance: 29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:04:22.814768 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-7894e6fd-f9c7-4e2d-9758-268d3b4e3206 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:22.815223 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-7894e6fd-f9c7-4e2d-9758-268d3b4e3206 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:22.816090 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-7894e6fd-f9c7-4e2d-9758-268d3b4e3206 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:22.816524 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-7894e6fd-f9c7-4e2d-9758-268d3b4e3206 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:23.013493 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-7894e6fd-f9c7-4e2d-9758-268d3b4e3206 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565618950dd54005a4a040f4dd0cbb33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c65d1e254f424ebfea8360aa697c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:04:23.016932 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-911a22e7-2516-4990-9fba-9ed3466757e4 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:04:23.017567 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-911a22e7-2516-4990-9fba-9ed3466757e4 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: 7ad07221-7c50-403d-9d99-8f876d7b7c63] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:04:23.022890 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-7894e6fd-f9c7-4e2d-9758-268d3b4e3206 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /compute/v2.1/servers/29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de" status: 200 len: 1576 microversion: 2.1 time: 0.219837 May 26 15:04:23.024317 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 529/1022] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:04:22 2021] GET /compute/v2.1/servers/29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de => generated 1576 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:04:23.026591 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-911a22e7-2516-4990-9fba-9ed3466757e4 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:23.027049 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-911a22e7-2516-4990-9fba-9ed3466757e4 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:23.027833 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-911a22e7-2516-4990-9fba-9ed3466757e4 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:23.028270 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-911a22e7-2516-4990-9fba-9ed3466757e4 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:23.401413 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-911a22e7-2516-4990-9fba-9ed3466757e4 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c2fb208b56d4d52b59ac09873f16180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e8cac36a174b2eb5a6e53fdf25b4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:04:23.409780 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-911a22e7-2516-4990-9fba-9ed3466757e4 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /compute/v2.1/servers/7ad07221-7c50-403d-9d99-8f876d7b7c63" status: 200 len: 1673 microversion: 2.1 time: 0.397302 May 26 15:04:23.410354 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 494/1023] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:04:23 2021] GET /compute/v2.1/servers/7ad07221-7c50-403d-9d99-8f876d7b7c63 => generated 1673 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:04:23.440750 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-b3c58aec-69db-471f-8f97-df13f95877d4 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:04:23.441363 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-b3c58aec-69db-471f-8f97-df13f95877d4 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 757c7def-93df-481f-b40d-7115f4bbbefe] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:04:23.460929 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-b3c58aec-69db-471f-8f97-df13f95877d4 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:23.461383 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-b3c58aec-69db-471f-8f97-df13f95877d4 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:23.462198 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-b3c58aec-69db-471f-8f97-df13f95877d4 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:23.462640 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-b3c58aec-69db-471f-8f97-df13f95877d4 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:23.600920 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-2df4d865-97db-42d7-ba31-0dfdc23ea4f6 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:04:23.601528 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-2df4d865-97db-42d7-ba31-0dfdc23ea4f6 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] [instance: 40591370-dbd3-45b4-b6c6-a0e01a614c28] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:04:23.609277 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-2df4d865-97db-42d7-ba31-0dfdc23ea4f6 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:23.610388 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-2df4d865-97db-42d7-ba31-0dfdc23ea4f6 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:23.611280 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-2df4d865-97db-42d7-ba31-0dfdc23ea4f6 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:23.611731 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-2df4d865-97db-42d7-ba31-0dfdc23ea4f6 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:23.718159 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-b3c58aec-69db-471f-8f97-df13f95877d4 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:04:23.728078 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-b3c58aec-69db-471f-8f97-df13f95877d4 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:04:23.729802 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-b3c58aec-69db-471f-8f97-df13f95877d4 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:04:23.731045 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-b3c58aec-69db-471f-8f97-df13f95877d4 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe" status: 200 len: 1731 microversion: 2.20 time: 0.294774 May 26 15:04:23.731784 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 530/1024] 10.222.0.81 () {60 vars in 1277 bytes} [Wed May 26 15:04:23 2021] GET /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe => generated 1731 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:04:23.925847 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-2df4d865-97db-42d7-ba31-0dfdc23ea4f6 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf31e2b7edd47c8835741c0dd03b7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83937b4f3831489289cd8aec97222f77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:04:23.935038 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-2df4d865-97db-42d7-ba31-0dfdc23ea4f6 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] 10.222.0.81 "GET /compute/v2.1/servers/40591370-dbd3-45b4-b6c6-a0e01a614c28" status: 200 len: 1755 microversion: 2.1 time: 0.337751 May 26 15:04:23.935620 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 495/1025] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:04:23 2021] GET /compute/v2.1/servers/40591370-dbd3-45b4-b6c6-a0e01a614c28 => generated 1755 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:04:24.041286 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-07212260-ae9e-4e6b-a7a4-9372b080c1aa tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:04:24.042478 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-07212260-ae9e-4e6b-a7a4-9372b080c1aa tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] [instance: 29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:04:24.050571 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-07212260-ae9e-4e6b-a7a4-9372b080c1aa tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:24.051255 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-07212260-ae9e-4e6b-a7a4-9372b080c1aa tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:24.052358 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-07212260-ae9e-4e6b-a7a4-9372b080c1aa tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:24.052803 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-07212260-ae9e-4e6b-a7a4-9372b080c1aa tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:24.426993 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-4d5441bc-cc52-440b-b6d1-c154fd7ee336 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:04:24.427704 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-4d5441bc-cc52-440b-b6d1-c154fd7ee336 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: 7ad07221-7c50-403d-9d99-8f876d7b7c63] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:04:24.434936 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-4d5441bc-cc52-440b-b6d1-c154fd7ee336 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:24.435781 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-4d5441bc-cc52-440b-b6d1-c154fd7ee336 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:24.436280 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-4d5441bc-cc52-440b-b6d1-c154fd7ee336 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:24.436719 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-4d5441bc-cc52-440b-b6d1-c154fd7ee336 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:24.522132 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-07212260-ae9e-4e6b-a7a4-9372b080c1aa tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565618950dd54005a4a040f4dd0cbb33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c65d1e254f424ebfea8360aa697c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:04:24.533610 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-07212260-ae9e-4e6b-a7a4-9372b080c1aa tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /compute/v2.1/servers/29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de" status: 200 len: 1576 microversion: 2.1 time: 0.495987 May 26 15:04:24.533995 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 531/1026] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:04:24 2021] GET /compute/v2.1/servers/29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de => generated 1576 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:04:24.644282 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-4d5441bc-cc52-440b-b6d1-c154fd7ee336 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c2fb208b56d4d52b59ac09873f16180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e8cac36a174b2eb5a6e53fdf25b4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:04:24.653169 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-4d5441bc-cc52-440b-b6d1-c154fd7ee336 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /compute/v2.1/servers/7ad07221-7c50-403d-9d99-8f876d7b7c63" status: 200 len: 1673 microversion: 2.1 time: 0.230081 May 26 15:04:24.653773 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 496/1027] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:04:24 2021] GET /compute/v2.1/servers/7ad07221-7c50-403d-9d99-8f876d7b7c63 => generated 1673 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:04:24.756348 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-ee0a1257-e76e-49db-a44b-9268fdbd4192 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:04:24.758381 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-ee0a1257-e76e-49db-a44b-9268fdbd4192 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 757c7def-93df-481f-b40d-7115f4bbbefe] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:04:24.784440 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-ee0a1257-e76e-49db-a44b-9268fdbd4192 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:24.785296 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-ee0a1257-e76e-49db-a44b-9268fdbd4192 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:24.786437 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-ee0a1257-e76e-49db-a44b-9268fdbd4192 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:24.787337 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-ee0a1257-e76e-49db-a44b-9268fdbd4192 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:24.955116 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-814d4d85-0cc5-49df-b8b2-1ab75673df14 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:04:24.955116 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-814d4d85-0cc5-49df-b8b2-1ab75673df14 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] [instance: 40591370-dbd3-45b4-b6c6-a0e01a614c28] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:04:24.966963 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-814d4d85-0cc5-49df-b8b2-1ab75673df14 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:24.967717 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-814d4d85-0cc5-49df-b8b2-1ab75673df14 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:24.968679 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-814d4d85-0cc5-49df-b8b2-1ab75673df14 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:24.983754 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-814d4d85-0cc5-49df-b8b2-1ab75673df14 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:25.261195 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-814d4d85-0cc5-49df-b8b2-1ab75673df14 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf31e2b7edd47c8835741c0dd03b7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83937b4f3831489289cd8aec97222f77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:04:25.274263 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-814d4d85-0cc5-49df-b8b2-1ab75673df14 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] 10.222.0.81 "GET /compute/v2.1/servers/40591370-dbd3-45b4-b6c6-a0e01a614c28" status: 200 len: 1755 microversion: 2.1 time: 0.325524 May 26 15:04:25.275814 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 497/1028] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:04:24 2021] GET /compute/v2.1/servers/40591370-dbd3-45b4-b6c6-a0e01a614c28 => generated 1755 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:04:25.549846 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-858fee53-8994-46c9-87ab-9502a9faca89 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:04:25.550471 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-858fee53-8994-46c9-87ab-9502a9faca89 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] [instance: 29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:04:25.557996 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-858fee53-8994-46c9-87ab-9502a9faca89 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:25.558458 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-858fee53-8994-46c9-87ab-9502a9faca89 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:25.559245 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-858fee53-8994-46c9-87ab-9502a9faca89 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:25.559686 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-858fee53-8994-46c9-87ab-9502a9faca89 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:25.567557 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-ee0a1257-e76e-49db-a44b-9268fdbd4192 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:04:25.579822 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-ee0a1257-e76e-49db-a44b-9268fdbd4192 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:04:25.605441 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-ee0a1257-e76e-49db-a44b-9268fdbd4192 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:04:25.618825 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-ee0a1257-e76e-49db-a44b-9268fdbd4192 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe" status: 200 len: 1731 microversion: 2.20 time: 0.871115 May 26 15:04:25.619747 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 532/1029] 10.222.0.81 () {60 vars in 1277 bytes} [Wed May 26 15:04:24 2021] GET /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe => generated 1731 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:04:25.670426 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-95437dc3-9cbb-4e68-aba6-5ceff4e9b709 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:04:25.671653 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-95437dc3-9cbb-4e68-aba6-5ceff4e9b709 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: 7ad07221-7c50-403d-9d99-8f876d7b7c63] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:04:25.692765 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-95437dc3-9cbb-4e68-aba6-5ceff4e9b709 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:25.693239 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-95437dc3-9cbb-4e68-aba6-5ceff4e9b709 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:25.694067 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-95437dc3-9cbb-4e68-aba6-5ceff4e9b709 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:25.694518 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-95437dc3-9cbb-4e68-aba6-5ceff4e9b709 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:25.823375 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-95437dc3-9cbb-4e68-aba6-5ceff4e9b709 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c2fb208b56d4d52b59ac09873f16180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e8cac36a174b2eb5a6e53fdf25b4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:04:25.832066 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-95437dc3-9cbb-4e68-aba6-5ceff4e9b709 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /compute/v2.1/servers/7ad07221-7c50-403d-9d99-8f876d7b7c63" status: 200 len: 1605 microversion: 2.1 time: 0.165578 May 26 15:04:25.833236 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 533/1030] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:04:25 2021] GET /compute/v2.1/servers/7ad07221-7c50-403d-9d99-8f876d7b7c63 => generated 1605 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:04:25.839585 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-858fee53-8994-46c9-87ab-9502a9faca89 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565618950dd54005a4a040f4dd0cbb33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c65d1e254f424ebfea8360aa697c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:04:25.850291 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-858fee53-8994-46c9-87ab-9502a9faca89 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /compute/v2.1/servers/29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de" status: 200 len: 1576 microversion: 2.1 time: 0.304000 May 26 15:04:25.850291 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 498/1031] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:04:25 2021] GET /compute/v2.1/servers/29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de => generated 1576 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:04:26.151294 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [req-dd43342d-304a-41b0-beb7-63ba25719e37 req-029d6c22-8ee1-4a4d-acc0-0db89f5186f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ad07221-7c50-403d-9d99-8f876d7b7c63", "name": "network-vif-deleted", "tag": "5bd02faf-9eb5-4f97-86fd-6985a1bd6902"}]} {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:04:26.152997 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 15:04:26.152997 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: warnings.warn(msg) May 26 15:04:26.162297 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [req-dd43342d-304a-41b0-beb7-63ba25719e37 req-029d6c22-8ee1-4a4d-acc0-0db89f5186f6 service nova] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:26.162754 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [req-dd43342d-304a-41b0-beb7-63ba25719e37 req-029d6c22-8ee1-4a4d-acc0-0db89f5186f6 service nova] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:26.179525 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.compute.server_external_events [req-dd43342d-304a-41b0-beb7-63ba25719e37 req-029d6c22-8ee1-4a4d-acc0-0db89f5186f6 service nova] Creating event network-vif-deleted:5bd02faf-9eb5-4f97-86fd-6985a1bd6902 for instance 7ad07221-7c50-403d-9d99-8f876d7b7c63 on hv-cinder-78414 May 26 15:04:26.184784 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [req-dd43342d-304a-41b0-beb7-63ba25719e37 req-029d6c22-8ee1-4a4d-acc0-0db89f5186f6 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037325 May 26 15:04:26.185849 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 534/1032] 10.222.0.81 () {64 vars in 1318 bytes} [Wed May 26 15:04:26 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 15:04:26.300890 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-7e483811-1386-4e2d-b101-a8464cfbc054 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:04:26.301848 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-7e483811-1386-4e2d-b101-a8464cfbc054 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] [instance: 40591370-dbd3-45b4-b6c6-a0e01a614c28] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:04:26.313681 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-7e483811-1386-4e2d-b101-a8464cfbc054 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:26.314513 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-7e483811-1386-4e2d-b101-a8464cfbc054 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:26.315571 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-7e483811-1386-4e2d-b101-a8464cfbc054 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:26.316866 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-7e483811-1386-4e2d-b101-a8464cfbc054 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:26.598969 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-7e483811-1386-4e2d-b101-a8464cfbc054 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf31e2b7edd47c8835741c0dd03b7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83937b4f3831489289cd8aec97222f77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:04:26.607893 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-7e483811-1386-4e2d-b101-a8464cfbc054 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] 10.222.0.81 "GET /compute/v2.1/servers/40591370-dbd3-45b4-b6c6-a0e01a614c28" status: 200 len: 1755 microversion: 2.1 time: 0.312910 May 26 15:04:26.608466 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 499/1033] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:04:26 2021] GET /compute/v2.1/servers/40591370-dbd3-45b4-b6c6-a0e01a614c28 => generated 1755 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:04:26.639120 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-516febed-6e02-4dfb-b0f2-1143bae5874c tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:04:26.639824 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-516febed-6e02-4dfb-b0f2-1143bae5874c tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 757c7def-93df-481f-b40d-7115f4bbbefe] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:04:26.647980 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-516febed-6e02-4dfb-b0f2-1143bae5874c tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:26.648710 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-516febed-6e02-4dfb-b0f2-1143bae5874c tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:26.649506 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-516febed-6e02-4dfb-b0f2-1143bae5874c tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:26.649974 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-516febed-6e02-4dfb-b0f2-1143bae5874c tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:26.850331 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-6cf11471-b02c-4d27-a25f-d8547da01290 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:04:26.851685 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-6cf11471-b02c-4d27-a25f-d8547da01290 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: 7ad07221-7c50-403d-9d99-8f876d7b7c63] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:04:26.861977 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-6cf11471-b02c-4d27-a25f-d8547da01290 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:26.863303 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-6cf11471-b02c-4d27-a25f-d8547da01290 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:26.864111 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-6cf11471-b02c-4d27-a25f-d8547da01290 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:26.864559 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-6cf11471-b02c-4d27-a25f-d8547da01290 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:26.865259 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-516febed-6e02-4dfb-b0f2-1143bae5874c tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:04:26.874318 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-516febed-6e02-4dfb-b0f2-1143bae5874c tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:04:26.876396 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-516febed-6e02-4dfb-b0f2-1143bae5874c tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:04:26.877571 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-516febed-6e02-4dfb-b0f2-1143bae5874c tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe" status: 200 len: 1731 microversion: 2.20 time: 0.242619 May 26 15:04:26.878141 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 535/1034] 10.222.0.81 () {60 vars in 1277 bytes} [Wed May 26 15:04:26 2021] GET /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe => generated 1731 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:04:26.888427 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-9e2b75e3-ef5e-444a-8848-47e7903a1579 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:04:26.889267 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-9e2b75e3-ef5e-444a-8848-47e7903a1579 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] [instance: 29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:04:26.897448 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-9e2b75e3-ef5e-444a-8848-47e7903a1579 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:26.897952 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-9e2b75e3-ef5e-444a-8848-47e7903a1579 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:26.899001 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-9e2b75e3-ef5e-444a-8848-47e7903a1579 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:26.899444 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-9e2b75e3-ef5e-444a-8848-47e7903a1579 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:26.983332 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-6cf11471-b02c-4d27-a25f-d8547da01290 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c2fb208b56d4d52b59ac09873f16180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e8cac36a174b2eb5a6e53fdf25b4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:04:26.992158 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-6cf11471-b02c-4d27-a25f-d8547da01290 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /compute/v2.1/servers/7ad07221-7c50-403d-9d99-8f876d7b7c63" status: 200 len: 1605 microversion: 2.1 time: 0.145437 May 26 15:04:26.992743 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 500/1035] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:04:26 2021] GET /compute/v2.1/servers/7ad07221-7c50-403d-9d99-8f876d7b7c63 => generated 1605 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:04:27.122928 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-9e2b75e3-ef5e-444a-8848-47e7903a1579 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565618950dd54005a4a040f4dd0cbb33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c65d1e254f424ebfea8360aa697c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:04:27.133065 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-9e2b75e3-ef5e-444a-8848-47e7903a1579 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /compute/v2.1/servers/29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de" status: 200 len: 1576 microversion: 2.1 time: 0.253642 May 26 15:04:27.134026 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 536/1036] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:04:26 2021] GET /compute/v2.1/servers/29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de => generated 1576 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:04:27.294583 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [req-822b3761-d9ce-4e6e-852f-aafef4302d40 req-32773706-a6b3-46a6-9706-116d5ee756dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de", "name": "network-vif-plugged", "status": "completed", "tag": "24388d3c-fd02-41f5-996a-da7452902c2b"}]} {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:04:27.296385 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 15:04:27.296385 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: warnings.warn(msg) May 26 15:04:27.305496 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [req-822b3761-d9ce-4e6e-852f-aafef4302d40 req-32773706-a6b3-46a6-9706-116d5ee756dc service nova] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:27.309489 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [req-822b3761-d9ce-4e6e-852f-aafef4302d40 req-32773706-a6b3-46a6-9706-116d5ee756dc service nova] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:27.322547 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.compute.server_external_events [req-822b3761-d9ce-4e6e-852f-aafef4302d40 req-32773706-a6b3-46a6-9706-116d5ee756dc service nova] Creating event network-vif-plugged:24388d3c-fd02-41f5-996a-da7452902c2b for instance 29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de on hv-cinder-78414 May 26 15:04:27.327354 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [req-822b3761-d9ce-4e6e-852f-aafef4302d40 req-32773706-a6b3-46a6-9706-116d5ee756dc service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036493 May 26 15:04:27.327956 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 501/1037] 10.222.0.81 () {64 vars in 1318 bytes} [Wed May 26 15:04:27 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:04:27.624392 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-1f5be131-0bca-4917-a851-c33ebbc0f7ce tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:04:27.625047 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-1f5be131-0bca-4917-a851-c33ebbc0f7ce tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] [instance: 40591370-dbd3-45b4-b6c6-a0e01a614c28] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:04:27.633980 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-1f5be131-0bca-4917-a851-c33ebbc0f7ce tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:27.634410 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-1f5be131-0bca-4917-a851-c33ebbc0f7ce tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:27.635098 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-1f5be131-0bca-4917-a851-c33ebbc0f7ce tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:27.635530 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-1f5be131-0bca-4917-a851-c33ebbc0f7ce tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:27.836986 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-1f5be131-0bca-4917-a851-c33ebbc0f7ce tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf31e2b7edd47c8835741c0dd03b7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83937b4f3831489289cd8aec97222f77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:04:27.849304 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-1f5be131-0bca-4917-a851-c33ebbc0f7ce tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] 10.222.0.81 "GET /compute/v2.1/servers/40591370-dbd3-45b4-b6c6-a0e01a614c28" status: 200 len: 1755 microversion: 2.1 time: 0.228498 May 26 15:04:27.850037 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 537/1038] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:04:27 2021] GET /compute/v2.1/servers/40591370-dbd3-45b4-b6c6-a0e01a614c28 => generated 1755 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:04:27.897228 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-f309d803-c889-4e82-b347-21f8f265b163 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:04:27.897971 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-f309d803-c889-4e82-b347-21f8f265b163 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 757c7def-93df-481f-b40d-7115f4bbbefe] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:04:27.905863 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-f309d803-c889-4e82-b347-21f8f265b163 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:27.906350 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-f309d803-c889-4e82-b347-21f8f265b163 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:27.907152 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-f309d803-c889-4e82-b347-21f8f265b163 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:27.907597 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-f309d803-c889-4e82-b347-21f8f265b163 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:28.011201 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-afbf7937-65e4-4c4e-ac6c-7ae56f4220ae tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:04:28.011875 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-afbf7937-65e4-4c4e-ac6c-7ae56f4220ae tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: 7ad07221-7c50-403d-9d99-8f876d7b7c63] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:04:28.020038 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-afbf7937-65e4-4c4e-ac6c-7ae56f4220ae tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:28.020537 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-afbf7937-65e4-4c4e-ac6c-7ae56f4220ae tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:28.021347 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-afbf7937-65e4-4c4e-ac6c-7ae56f4220ae tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:28.021822 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-afbf7937-65e4-4c4e-ac6c-7ae56f4220ae tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:28.223398 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-afbf7937-65e4-4c4e-ac6c-7ae56f4220ae tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c2fb208b56d4d52b59ac09873f16180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e8cac36a174b2eb5a6e53fdf25b4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:04:28.233769 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-afbf7937-65e4-4c4e-ac6c-7ae56f4220ae tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /compute/v2.1/servers/7ad07221-7c50-403d-9d99-8f876d7b7c63" status: 200 len: 1605 microversion: 2.1 time: 0.226058 May 26 15:04:28.245079 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 538/1039] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:04:28 2021] GET /compute/v2.1/servers/7ad07221-7c50-403d-9d99-8f876d7b7c63 => generated 1605 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:04:28.250070 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-323552eb-f3af-4d00-b518-bab7661f5d1b tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:04:28.251495 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-323552eb-f3af-4d00-b518-bab7661f5d1b tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] [instance: 29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:04:28.264689 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-323552eb-f3af-4d00-b518-bab7661f5d1b tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:28.265311 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-323552eb-f3af-4d00-b518-bab7661f5d1b tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:28.266987 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-323552eb-f3af-4d00-b518-bab7661f5d1b tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:28.268018 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-323552eb-f3af-4d00-b518-bab7661f5d1b tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:28.279185 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-f309d803-c889-4e82-b347-21f8f265b163 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:04:28.289832 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-f309d803-c889-4e82-b347-21f8f265b163 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:04:28.291661 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-f309d803-c889-4e82-b347-21f8f265b163 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:04:28.293076 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-f309d803-c889-4e82-b347-21f8f265b163 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe" status: 200 len: 1731 microversion: 2.20 time: 0.400583 May 26 15:04:28.299653 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 502/1040] 10.222.0.81 () {60 vars in 1277 bytes} [Wed May 26 15:04:27 2021] GET /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe => generated 1731 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:04:28.600068 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-323552eb-f3af-4d00-b518-bab7661f5d1b tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565618950dd54005a4a040f4dd0cbb33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c65d1e254f424ebfea8360aa697c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:04:28.608231 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-323552eb-f3af-4d00-b518-bab7661f5d1b tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /compute/v2.1/servers/29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de" status: 200 len: 1576 microversion: 2.1 time: 0.361888 May 26 15:04:28.608791 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 539/1041] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:04:28 2021] GET /compute/v2.1/servers/29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de => generated 1576 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:04:28.866709 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-47f72b42-c64a-457a-a98f-e462145afaed tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:04:28.867241 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-47f72b42-c64a-457a-a98f-e462145afaed tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] [instance: 40591370-dbd3-45b4-b6c6-a0e01a614c28] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:04:28.874492 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-47f72b42-c64a-457a-a98f-e462145afaed tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:28.874940 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-47f72b42-c64a-457a-a98f-e462145afaed tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:28.876203 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-47f72b42-c64a-457a-a98f-e462145afaed tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:28.876635 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-47f72b42-c64a-457a-a98f-e462145afaed tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:29.071701 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-47f72b42-c64a-457a-a98f-e462145afaed tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf31e2b7edd47c8835741c0dd03b7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83937b4f3831489289cd8aec97222f77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:04:29.100773 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-47f72b42-c64a-457a-a98f-e462145afaed tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] 10.222.0.81 "GET /compute/v2.1/servers/40591370-dbd3-45b4-b6c6-a0e01a614c28" status: 200 len: 1755 microversion: 2.1 time: 0.237407 May 26 15:04:29.115343 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 503/1042] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:04:28 2021] GET /compute/v2.1/servers/40591370-dbd3-45b4-b6c6-a0e01a614c28 => generated 1755 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:04:29.259001 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-dc3643c6-fada-40ec-8d8f-18c46530e3cd tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:04:29.259632 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-dc3643c6-fada-40ec-8d8f-18c46530e3cd tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: 7ad07221-7c50-403d-9d99-8f876d7b7c63] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:04:29.267525 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-dc3643c6-fada-40ec-8d8f-18c46530e3cd tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:29.267984 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-dc3643c6-fada-40ec-8d8f-18c46530e3cd tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:29.268767 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-dc3643c6-fada-40ec-8d8f-18c46530e3cd tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:29.269213 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-dc3643c6-fada-40ec-8d8f-18c46530e3cd tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:29.312055 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-d9851ee7-fd86-4652-95c9-341ae2832ff0 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:04:29.312754 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-d9851ee7-fd86-4652-95c9-341ae2832ff0 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 757c7def-93df-481f-b40d-7115f4bbbefe] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:04:29.322041 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-d9851ee7-fd86-4652-95c9-341ae2832ff0 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:29.322515 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-d9851ee7-fd86-4652-95c9-341ae2832ff0 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:29.323522 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-d9851ee7-fd86-4652-95c9-341ae2832ff0 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:29.324235 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-d9851ee7-fd86-4652-95c9-341ae2832ff0 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:29.402265 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-dc3643c6-fada-40ec-8d8f-18c46530e3cd tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c2fb208b56d4d52b59ac09873f16180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e8cac36a174b2eb5a6e53fdf25b4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:04:29.413580 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-dc3643c6-fada-40ec-8d8f-18c46530e3cd tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /compute/v2.1/servers/7ad07221-7c50-403d-9d99-8f876d7b7c63" status: 200 len: 1605 microversion: 2.1 time: 0.158130 May 26 15:04:29.414414 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 540/1043] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:04:29 2021] GET /compute/v2.1/servers/7ad07221-7c50-403d-9d99-8f876d7b7c63 => generated 1605 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:04:29.625468 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-e6c61b82-47ce-473b-bd65-520f12ef3b4c tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:04:29.626528 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-e6c61b82-47ce-473b-bd65-520f12ef3b4c tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] [instance: 29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:04:29.633614 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-e6c61b82-47ce-473b-bd65-520f12ef3b4c tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:29.634304 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-e6c61b82-47ce-473b-bd65-520f12ef3b4c tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:29.635102 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-e6c61b82-47ce-473b-bd65-520f12ef3b4c tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:29.635552 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-e6c61b82-47ce-473b-bd65-520f12ef3b4c tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:29.677222 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-d9851ee7-fd86-4652-95c9-341ae2832ff0 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:04:29.687026 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-d9851ee7-fd86-4652-95c9-341ae2832ff0 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:04:29.688773 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-d9851ee7-fd86-4652-95c9-341ae2832ff0 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:04:29.689992 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-d9851ee7-fd86-4652-95c9-341ae2832ff0 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe" status: 200 len: 1731 microversion: 2.20 time: 0.381858 May 26 15:04:29.691007 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 504/1044] 10.222.0.81 () {60 vars in 1277 bytes} [Wed May 26 15:04:29 2021] GET /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe => generated 1731 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 15:04:29.859233 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-e6c61b82-47ce-473b-bd65-520f12ef3b4c tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565618950dd54005a4a040f4dd0cbb33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c65d1e254f424ebfea8360aa697c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:04:29.868930 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-e6c61b82-47ce-473b-bd65-520f12ef3b4c tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /compute/v2.1/servers/29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de" status: 200 len: 1576 microversion: 2.1 time: 0.247328 May 26 15:04:29.869576 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 541/1045] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:04:29 2021] GET /compute/v2.1/servers/29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de => generated 1576 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:04:30.121012 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-965aecc8-a225-4b13-b2ca-6c61625c29b6 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:04:30.121863 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-965aecc8-a225-4b13-b2ca-6c61625c29b6 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] [instance: 40591370-dbd3-45b4-b6c6-a0e01a614c28] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:04:30.129820 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-965aecc8-a225-4b13-b2ca-6c61625c29b6 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:30.130273 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-965aecc8-a225-4b13-b2ca-6c61625c29b6 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:30.131315 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-965aecc8-a225-4b13-b2ca-6c61625c29b6 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:30.131942 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-965aecc8-a225-4b13-b2ca-6c61625c29b6 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:30.364652 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-965aecc8-a225-4b13-b2ca-6c61625c29b6 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf31e2b7edd47c8835741c0dd03b7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83937b4f3831489289cd8aec97222f77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:04:30.376575 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-965aecc8-a225-4b13-b2ca-6c61625c29b6 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] 10.222.0.81 "GET /compute/v2.1/servers/40591370-dbd3-45b4-b6c6-a0e01a614c28" status: 200 len: 1755 microversion: 2.1 time: 0.259262 May 26 15:04:30.376575 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 505/1046] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:04:30 2021] GET /compute/v2.1/servers/40591370-dbd3-45b4-b6c6-a0e01a614c28 => generated 1755 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:04:30.430863 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-8cd0893d-7c99-4726-8fe1-60d4788a4e65 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:04:30.431456 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-8cd0893d-7c99-4726-8fe1-60d4788a4e65 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: 7ad07221-7c50-403d-9d99-8f876d7b7c63] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:04:30.439343 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-8cd0893d-7c99-4726-8fe1-60d4788a4e65 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:30.446269 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-8cd0893d-7c99-4726-8fe1-60d4788a4e65 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:30.447229 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-8cd0893d-7c99-4726-8fe1-60d4788a4e65 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:30.447772 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-8cd0893d-7c99-4726-8fe1-60d4788a4e65 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:30.580487 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-8cd0893d-7c99-4726-8fe1-60d4788a4e65 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c2fb208b56d4d52b59ac09873f16180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e8cac36a174b2eb5a6e53fdf25b4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:04:30.588679 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-8cd0893d-7c99-4726-8fe1-60d4788a4e65 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /compute/v2.1/servers/7ad07221-7c50-403d-9d99-8f876d7b7c63" status: 200 len: 1605 microversion: 2.1 time: 0.161482 May 26 15:04:30.589246 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 542/1047] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:04:30 2021] GET /compute/v2.1/servers/7ad07221-7c50-403d-9d99-8f876d7b7c63 => generated 1605 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:04:30.709817 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-229e82f7-6f89-4e94-ac77-46f189d332f8 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:04:30.710445 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-229e82f7-6f89-4e94-ac77-46f189d332f8 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 757c7def-93df-481f-b40d-7115f4bbbefe] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:04:30.718214 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-229e82f7-6f89-4e94-ac77-46f189d332f8 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:30.718679 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-229e82f7-6f89-4e94-ac77-46f189d332f8 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:30.720300 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-229e82f7-6f89-4e94-ac77-46f189d332f8 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:30.720730 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-229e82f7-6f89-4e94-ac77-46f189d332f8 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:30.885781 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-1ec4fcba-548a-42fb-872a-1f38a2cdf981 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:04:30.886494 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-1ec4fcba-548a-42fb-872a-1f38a2cdf981 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] [instance: 29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:04:30.893885 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-1ec4fcba-548a-42fb-872a-1f38a2cdf981 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:30.894420 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-1ec4fcba-548a-42fb-872a-1f38a2cdf981 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:30.895267 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-1ec4fcba-548a-42fb-872a-1f38a2cdf981 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:30.895778 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-1ec4fcba-548a-42fb-872a-1f38a2cdf981 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:30.928215 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-229e82f7-6f89-4e94-ac77-46f189d332f8 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:04:30.946327 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-229e82f7-6f89-4e94-ac77-46f189d332f8 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:04:30.950562 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-229e82f7-6f89-4e94-ac77-46f189d332f8 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:04:30.951993 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-229e82f7-6f89-4e94-ac77-46f189d332f8 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe" status: 200 len: 1731 microversion: 2.20 time: 0.246225 May 26 15:04:30.953034 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 506/1048] 10.222.0.81 () {60 vars in 1277 bytes} [Wed May 26 15:04:30 2021] GET /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe => generated 1731 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 15:04:31.109100 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-1ec4fcba-548a-42fb-872a-1f38a2cdf981 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565618950dd54005a4a040f4dd0cbb33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c65d1e254f424ebfea8360aa697c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:04:31.117934 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-1ec4fcba-548a-42fb-872a-1f38a2cdf981 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /compute/v2.1/servers/29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de" status: 200 len: 1576 microversion: 2.1 time: 0.235742 May 26 15:04:31.118505 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 543/1049] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:04:30 2021] GET /compute/v2.1/servers/29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de => generated 1576 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:04:31.392453 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-db984b6c-7c46-46dd-8d14-c43d633a7ca2 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:04:31.393074 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-db984b6c-7c46-46dd-8d14-c43d633a7ca2 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] [instance: 40591370-dbd3-45b4-b6c6-a0e01a614c28] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:04:31.401067 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-db984b6c-7c46-46dd-8d14-c43d633a7ca2 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:31.401516 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-db984b6c-7c46-46dd-8d14-c43d633a7ca2 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:31.402325 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-db984b6c-7c46-46dd-8d14-c43d633a7ca2 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:31.402758 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-db984b6c-7c46-46dd-8d14-c43d633a7ca2 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:31.602399 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-db984b6c-7c46-46dd-8d14-c43d633a7ca2 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf31e2b7edd47c8835741c0dd03b7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83937b4f3831489289cd8aec97222f77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:04:31.606196 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-275ba770-f2c4-4276-8157-ca940402b266 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:04:31.606853 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-275ba770-f2c4-4276-8157-ca940402b266 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: 7ad07221-7c50-403d-9d99-8f876d7b7c63] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:04:31.611861 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-db984b6c-7c46-46dd-8d14-c43d633a7ca2 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] 10.222.0.81 "GET /compute/v2.1/servers/40591370-dbd3-45b4-b6c6-a0e01a614c28" status: 200 len: 1755 microversion: 2.1 time: 0.223392 May 26 15:04:31.612420 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 507/1050] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:04:31 2021] GET /compute/v2.1/servers/40591370-dbd3-45b4-b6c6-a0e01a614c28 => generated 1755 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:04:31.614982 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-275ba770-f2c4-4276-8157-ca940402b266 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:31.615437 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-275ba770-f2c4-4276-8157-ca940402b266 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:31.616212 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-275ba770-f2c4-4276-8157-ca940402b266 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:31.616657 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-275ba770-f2c4-4276-8157-ca940402b266 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:31.737695 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-275ba770-f2c4-4276-8157-ca940402b266 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c2fb208b56d4d52b59ac09873f16180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e8cac36a174b2eb5a6e53fdf25b4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:04:31.747109 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-275ba770-f2c4-4276-8157-ca940402b266 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /compute/v2.1/servers/7ad07221-7c50-403d-9d99-8f876d7b7c63" status: 200 len: 1605 microversion: 2.1 time: 0.144470 May 26 15:04:31.748368 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 544/1051] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:04:31 2021] GET /compute/v2.1/servers/7ad07221-7c50-403d-9d99-8f876d7b7c63 => generated 1605 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:04:31.972297 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-5d70c287-2cf6-4ce2-851a-1e59c5ec0406 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:04:31.980498 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-5d70c287-2cf6-4ce2-851a-1e59c5ec0406 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 757c7def-93df-481f-b40d-7115f4bbbefe] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:04:31.980498 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-5d70c287-2cf6-4ce2-851a-1e59c5ec0406 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:31.980774 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-5d70c287-2cf6-4ce2-851a-1e59c5ec0406 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:31.981575 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-5d70c287-2cf6-4ce2-851a-1e59c5ec0406 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:31.982019 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-5d70c287-2cf6-4ce2-851a-1e59c5ec0406 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:32.136144 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-b5e47309-323e-489c-b706-7683f1085cdb tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:04:32.136785 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-b5e47309-323e-489c-b706-7683f1085cdb tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] [instance: 29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:04:32.144834 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-b5e47309-323e-489c-b706-7683f1085cdb tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:32.145298 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-b5e47309-323e-489c-b706-7683f1085cdb tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:32.146130 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-b5e47309-323e-489c-b706-7683f1085cdb tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:32.146578 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-b5e47309-323e-489c-b706-7683f1085cdb tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:32.209575 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-5d70c287-2cf6-4ce2-851a-1e59c5ec0406 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:04:32.224034 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-5d70c287-2cf6-4ce2-851a-1e59c5ec0406 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:04:32.225591 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-5d70c287-2cf6-4ce2-851a-1e59c5ec0406 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:04:32.227450 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-5d70c287-2cf6-4ce2-851a-1e59c5ec0406 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe" status: 200 len: 1731 microversion: 2.20 time: 0.259067 May 26 15:04:32.228219 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 508/1052] 10.222.0.81 () {60 vars in 1277 bytes} [Wed May 26 15:04:31 2021] GET /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe => generated 1731 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:04:32.365720 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-b5e47309-323e-489c-b706-7683f1085cdb tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565618950dd54005a4a040f4dd0cbb33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c65d1e254f424ebfea8360aa697c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:04:32.374121 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-b5e47309-323e-489c-b706-7683f1085cdb tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /compute/v2.1/servers/29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de" status: 200 len: 1576 microversion: 2.1 time: 0.241682 May 26 15:04:32.374699 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 545/1053] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:04:32 2021] GET /compute/v2.1/servers/29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de => generated 1576 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:04:32.628923 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-81ab516c-3d04-4c0b-bb68-289554003f60 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:04:32.629642 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-81ab516c-3d04-4c0b-bb68-289554003f60 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] [instance: 40591370-dbd3-45b4-b6c6-a0e01a614c28] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:04:32.637005 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-81ab516c-3d04-4c0b-bb68-289554003f60 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:32.637463 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-81ab516c-3d04-4c0b-bb68-289554003f60 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:32.638282 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-81ab516c-3d04-4c0b-bb68-289554003f60 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:32.638724 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-81ab516c-3d04-4c0b-bb68-289554003f60 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:32.764157 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-f41a65e1-c031-411d-9001-23d074490c0b tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:04:32.764923 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-f41a65e1-c031-411d-9001-23d074490c0b tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: 7ad07221-7c50-403d-9d99-8f876d7b7c63] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:04:32.772670 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-f41a65e1-c031-411d-9001-23d074490c0b tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:32.773390 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-f41a65e1-c031-411d-9001-23d074490c0b tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:32.774208 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-f41a65e1-c031-411d-9001-23d074490c0b tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:32.774650 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-f41a65e1-c031-411d-9001-23d074490c0b tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:32.837369 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-81ab516c-3d04-4c0b-bb68-289554003f60 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf31e2b7edd47c8835741c0dd03b7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83937b4f3831489289cd8aec97222f77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:04:32.846514 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-81ab516c-3d04-4c0b-bb68-289554003f60 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] 10.222.0.81 "GET /compute/v2.1/servers/40591370-dbd3-45b4-b6c6-a0e01a614c28" status: 200 len: 1755 microversion: 2.1 time: 0.221328 May 26 15:04:32.847084 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 509/1054] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:04:32 2021] GET /compute/v2.1/servers/40591370-dbd3-45b4-b6c6-a0e01a614c28 => generated 1755 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:04:32.893877 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-f41a65e1-c031-411d-9001-23d074490c0b tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c2fb208b56d4d52b59ac09873f16180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e8cac36a174b2eb5a6e53fdf25b4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:04:32.902863 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-f41a65e1-c031-411d-9001-23d074490c0b tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /compute/v2.1/servers/7ad07221-7c50-403d-9d99-8f876d7b7c63" status: 200 len: 1605 microversion: 2.1 time: 0.142384 May 26 15:04:32.904087 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 546/1055] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:04:32 2021] GET /compute/v2.1/servers/7ad07221-7c50-403d-9d99-8f876d7b7c63 => generated 1605 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:04:33.246721 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-de3f78fb-94ad-4dc4-9e0b-297b782226a2 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:04:33.247456 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-de3f78fb-94ad-4dc4-9e0b-297b782226a2 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 757c7def-93df-481f-b40d-7115f4bbbefe] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:04:33.255601 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-de3f78fb-94ad-4dc4-9e0b-297b782226a2 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:33.256145 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-de3f78fb-94ad-4dc4-9e0b-297b782226a2 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:33.257016 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-de3f78fb-94ad-4dc4-9e0b-297b782226a2 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:33.257555 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-de3f78fb-94ad-4dc4-9e0b-297b782226a2 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:33.400027 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-e7ac390d-e8d0-4d65-ace8-2568c6143977 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:04:33.400637 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-e7ac390d-e8d0-4d65-ace8-2568c6143977 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] [instance: 29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:04:33.407800 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-e7ac390d-e8d0-4d65-ace8-2568c6143977 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:33.408248 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-e7ac390d-e8d0-4d65-ace8-2568c6143977 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:33.409024 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-e7ac390d-e8d0-4d65-ace8-2568c6143977 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:33.409861 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-e7ac390d-e8d0-4d65-ace8-2568c6143977 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:33.458674 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-de3f78fb-94ad-4dc4-9e0b-297b782226a2 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:04:33.467690 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-de3f78fb-94ad-4dc4-9e0b-297b782226a2 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:04:33.469921 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-de3f78fb-94ad-4dc4-9e0b-297b782226a2 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:04:33.471083 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-de3f78fb-94ad-4dc4-9e0b-297b782226a2 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe" status: 200 len: 1731 microversion: 2.20 time: 0.228120 May 26 15:04:33.471645 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 510/1056] 10.222.0.81 () {60 vars in 1277 bytes} [Wed May 26 15:04:33 2021] GET /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe => generated 1731 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:04:33.636677 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-e7ac390d-e8d0-4d65-ace8-2568c6143977 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565618950dd54005a4a040f4dd0cbb33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c65d1e254f424ebfea8360aa697c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:04:33.648556 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-e7ac390d-e8d0-4d65-ace8-2568c6143977 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /compute/v2.1/servers/29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de" status: 200 len: 1576 microversion: 2.1 time: 0.252020 May 26 15:04:33.650300 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 547/1057] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:04:33 2021] GET /compute/v2.1/servers/29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de => generated 1576 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:04:33.863754 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-1ef594bb-ebb5-49a1-88b2-dbd5229eaba7 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:04:33.864427 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-1ef594bb-ebb5-49a1-88b2-dbd5229eaba7 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] [instance: 40591370-dbd3-45b4-b6c6-a0e01a614c28] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:04:33.871791 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-1ef594bb-ebb5-49a1-88b2-dbd5229eaba7 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:33.872247 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-1ef594bb-ebb5-49a1-88b2-dbd5229eaba7 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:33.873021 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-1ef594bb-ebb5-49a1-88b2-dbd5229eaba7 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:33.873462 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-1ef594bb-ebb5-49a1-88b2-dbd5229eaba7 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:33.922129 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-424a3011-b140-48f5-a92c-13c5c9b71c56 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:04:33.922737 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-424a3011-b140-48f5-a92c-13c5c9b71c56 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: 7ad07221-7c50-403d-9d99-8f876d7b7c63] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:04:33.930085 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-424a3011-b140-48f5-a92c-13c5c9b71c56 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:33.930549 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-424a3011-b140-48f5-a92c-13c5c9b71c56 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:33.931325 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-424a3011-b140-48f5-a92c-13c5c9b71c56 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:33.931768 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-424a3011-b140-48f5-a92c-13c5c9b71c56 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:34.056849 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-424a3011-b140-48f5-a92c-13c5c9b71c56 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c2fb208b56d4d52b59ac09873f16180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e8cac36a174b2eb5a6e53fdf25b4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:04:34.065842 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-424a3011-b140-48f5-a92c-13c5c9b71c56 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /compute/v2.1/servers/7ad07221-7c50-403d-9d99-8f876d7b7c63" status: 200 len: 1605 microversion: 2.1 time: 0.147419 May 26 15:04:34.070143 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 548/1058] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:04:33 2021] GET /compute/v2.1/servers/7ad07221-7c50-403d-9d99-8f876d7b7c63 => generated 1605 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:04:34.104075 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-1ef594bb-ebb5-49a1-88b2-dbd5229eaba7 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf31e2b7edd47c8835741c0dd03b7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83937b4f3831489289cd8aec97222f77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:04:34.113771 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-1ef594bb-ebb5-49a1-88b2-dbd5229eaba7 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] 10.222.0.81 "GET /compute/v2.1/servers/40591370-dbd3-45b4-b6c6-a0e01a614c28" status: 200 len: 1755 microversion: 2.1 time: 0.253645 May 26 15:04:34.117586 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 511/1059] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:04:33 2021] GET /compute/v2.1/servers/40591370-dbd3-45b4-b6c6-a0e01a614c28 => generated 1755 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:04:34.491934 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-f4469a07-4376-45d4-b6de-8f898d60caea tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:04:34.492860 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-f4469a07-4376-45d4-b6de-8f898d60caea tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 757c7def-93df-481f-b40d-7115f4bbbefe] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:04:34.502750 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-f4469a07-4376-45d4-b6de-8f898d60caea tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:34.503758 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-f4469a07-4376-45d4-b6de-8f898d60caea tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:34.504004 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-f4469a07-4376-45d4-b6de-8f898d60caea tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:34.504449 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-f4469a07-4376-45d4-b6de-8f898d60caea tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:34.718385 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-503ac153-9fda-4029-8fdd-a4c875d06315 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:04:34.718385 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-503ac153-9fda-4029-8fdd-a4c875d06315 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] [instance: 29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:04:34.718385 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-503ac153-9fda-4029-8fdd-a4c875d06315 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:34.718385 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-503ac153-9fda-4029-8fdd-a4c875d06315 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:34.718884 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-503ac153-9fda-4029-8fdd-a4c875d06315 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:34.718884 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-503ac153-9fda-4029-8fdd-a4c875d06315 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:34.720169 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-f4469a07-4376-45d4-b6de-8f898d60caea tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:04:34.721959 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-f4469a07-4376-45d4-b6de-8f898d60caea tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:04:34.723476 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-f4469a07-4376-45d4-b6de-8f898d60caea tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:04:34.724613 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-f4469a07-4376-45d4-b6de-8f898d60caea tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe" status: 200 len: 1731 microversion: 2.20 time: 0.237891 May 26 15:04:34.725174 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 549/1060] 10.222.0.81 () {60 vars in 1277 bytes} [Wed May 26 15:04:34 2021] GET /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe => generated 1731 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:04:34.882258 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-503ac153-9fda-4029-8fdd-a4c875d06315 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565618950dd54005a4a040f4dd0cbb33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c65d1e254f424ebfea8360aa697c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:04:34.891501 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-503ac153-9fda-4029-8fdd-a4c875d06315 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /compute/v2.1/servers/29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de" status: 200 len: 1576 microversion: 2.1 time: 0.227631 May 26 15:04:34.901559 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 512/1061] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:04:34 2021] GET /compute/v2.1/servers/29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de => generated 1576 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:04:35.083462 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-0e54bc36-32e0-4535-b213-f3171e05c4ad tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:04:35.084028 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-0e54bc36-32e0-4535-b213-f3171e05c4ad tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: 7ad07221-7c50-403d-9d99-8f876d7b7c63] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:04:35.091293 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-0e54bc36-32e0-4535-b213-f3171e05c4ad tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:35.091756 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-0e54bc36-32e0-4535-b213-f3171e05c4ad tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:35.092567 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-0e54bc36-32e0-4535-b213-f3171e05c4ad tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:35.093009 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-0e54bc36-32e0-4535-b213-f3171e05c4ad tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:35.131378 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-ebe588f8-539e-4066-a9ca-60f0a20e20a4 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:04:35.132001 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-ebe588f8-539e-4066-a9ca-60f0a20e20a4 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] [instance: 40591370-dbd3-45b4-b6c6-a0e01a614c28] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:04:35.139115 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-ebe588f8-539e-4066-a9ca-60f0a20e20a4 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:35.139578 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-ebe588f8-539e-4066-a9ca-60f0a20e20a4 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:35.140354 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-ebe588f8-539e-4066-a9ca-60f0a20e20a4 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:35.141772 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-ebe588f8-539e-4066-a9ca-60f0a20e20a4 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:35.207072 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-0e54bc36-32e0-4535-b213-f3171e05c4ad tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c2fb208b56d4d52b59ac09873f16180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e8cac36a174b2eb5a6e53fdf25b4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:04:35.218219 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-0e54bc36-32e0-4535-b213-f3171e05c4ad tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /compute/v2.1/servers/7ad07221-7c50-403d-9d99-8f876d7b7c63" status: 200 len: 1605 microversion: 2.1 time: 0.138447 May 26 15:04:35.223661 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 550/1062] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:04:35 2021] GET /compute/v2.1/servers/7ad07221-7c50-403d-9d99-8f876d7b7c63 => generated 1605 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:04:35.360866 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-ebe588f8-539e-4066-a9ca-60f0a20e20a4 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf31e2b7edd47c8835741c0dd03b7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83937b4f3831489289cd8aec97222f77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:04:35.369531 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-ebe588f8-539e-4066-a9ca-60f0a20e20a4 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] 10.222.0.81 "GET /compute/v2.1/servers/40591370-dbd3-45b4-b6c6-a0e01a614c28" status: 200 len: 1755 microversion: 2.1 time: 0.241837 May 26 15:04:35.370220 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 513/1063] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:04:35 2021] GET /compute/v2.1/servers/40591370-dbd3-45b4-b6c6-a0e01a614c28 => generated 1755 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:04:35.742926 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-ef3ee518-d7fd-4da2-b511-31b1476cbb3e tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:04:35.743539 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-ef3ee518-d7fd-4da2-b511-31b1476cbb3e tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 757c7def-93df-481f-b40d-7115f4bbbefe] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:04:35.751076 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-ef3ee518-d7fd-4da2-b511-31b1476cbb3e tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:35.751536 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-ef3ee518-d7fd-4da2-b511-31b1476cbb3e tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:35.752486 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-ef3ee518-d7fd-4da2-b511-31b1476cbb3e tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:35.752959 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-ef3ee518-d7fd-4da2-b511-31b1476cbb3e tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:35.911393 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-97cd15f8-6118-4a3f-b59c-9e211115494c tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:04:35.992722 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-97cd15f8-6118-4a3f-b59c-9e211115494c tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] [instance: 29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:04:35.992722 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-97cd15f8-6118-4a3f-b59c-9e211115494c tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:35.992722 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-97cd15f8-6118-4a3f-b59c-9e211115494c tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:35.992722 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-97cd15f8-6118-4a3f-b59c-9e211115494c tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:35.993581 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-97cd15f8-6118-4a3f-b59c-9e211115494c tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:35.993713 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-ef3ee518-d7fd-4da2-b511-31b1476cbb3e tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:04:35.993713 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-ef3ee518-d7fd-4da2-b511-31b1476cbb3e tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:04:35.993919 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-ef3ee518-d7fd-4da2-b511-31b1476cbb3e tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:04:35.993919 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-ef3ee518-d7fd-4da2-b511-31b1476cbb3e tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe" status: 200 len: 1731 microversion: 2.20 time: 0.252436 May 26 15:04:35.993919 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 551/1064] 10.222.0.81 () {60 vars in 1277 bytes} [Wed May 26 15:04:35 2021] GET /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe => generated 1731 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:04:36.198926 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-97cd15f8-6118-4a3f-b59c-9e211115494c tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565618950dd54005a4a040f4dd0cbb33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c65d1e254f424ebfea8360aa697c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:04:36.208920 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-97cd15f8-6118-4a3f-b59c-9e211115494c tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /compute/v2.1/servers/29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de" status: 200 len: 1576 microversion: 2.1 time: 0.304348 May 26 15:04:36.209496 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 514/1065] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:04:35 2021] GET /compute/v2.1/servers/29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de => generated 1576 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:04:36.236111 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-5d37993f-ba9e-4a7c-98f5-19af2b8be155 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:04:36.236742 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-5d37993f-ba9e-4a7c-98f5-19af2b8be155 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: 7ad07221-7c50-403d-9d99-8f876d7b7c63] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:04:36.244091 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-5d37993f-ba9e-4a7c-98f5-19af2b8be155 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:36.244491 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-5d37993f-ba9e-4a7c-98f5-19af2b8be155 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:36.245278 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-5d37993f-ba9e-4a7c-98f5-19af2b8be155 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:36.245917 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-5d37993f-ba9e-4a7c-98f5-19af2b8be155 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:36.363295 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-5d37993f-ba9e-4a7c-98f5-19af2b8be155 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c2fb208b56d4d52b59ac09873f16180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e8cac36a174b2eb5a6e53fdf25b4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:04:36.371567 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-5d37993f-ba9e-4a7c-98f5-19af2b8be155 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /compute/v2.1/servers/7ad07221-7c50-403d-9d99-8f876d7b7c63" status: 200 len: 1605 microversion: 2.1 time: 0.139424 May 26 15:04:36.372209 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 552/1066] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:04:36 2021] GET /compute/v2.1/servers/7ad07221-7c50-403d-9d99-8f876d7b7c63 => generated 1605 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:04:36.387045 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-ccfa57f2-69ca-4443-814d-fd4c92cf900c tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:04:36.387652 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-ccfa57f2-69ca-4443-814d-fd4c92cf900c tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] [instance: 40591370-dbd3-45b4-b6c6-a0e01a614c28] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:04:36.395442 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-ccfa57f2-69ca-4443-814d-fd4c92cf900c tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:36.395897 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-ccfa57f2-69ca-4443-814d-fd4c92cf900c tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:36.396664 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-ccfa57f2-69ca-4443-814d-fd4c92cf900c tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:36.397101 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-ccfa57f2-69ca-4443-814d-fd4c92cf900c tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:36.602048 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-ccfa57f2-69ca-4443-814d-fd4c92cf900c tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf31e2b7edd47c8835741c0dd03b7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83937b4f3831489289cd8aec97222f77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:04:36.610808 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-ccfa57f2-69ca-4443-814d-fd4c92cf900c tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] 10.222.0.81 "GET /compute/v2.1/servers/40591370-dbd3-45b4-b6c6-a0e01a614c28" status: 200 len: 1755 microversion: 2.1 time: 0.227215 May 26 15:04:36.612387 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 515/1067] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:04:36 2021] GET /compute/v2.1/servers/40591370-dbd3-45b4-b6c6-a0e01a614c28 => generated 1755 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:04:37.010996 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-e8f5f8c1-50f3-4294-8bc4-346f81f56edf tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:04:37.011622 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-e8f5f8c1-50f3-4294-8bc4-346f81f56edf tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 757c7def-93df-481f-b40d-7115f4bbbefe] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:04:37.020560 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-e8f5f8c1-50f3-4294-8bc4-346f81f56edf tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:37.026761 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-e8f5f8c1-50f3-4294-8bc4-346f81f56edf tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:37.026761 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-e8f5f8c1-50f3-4294-8bc4-346f81f56edf tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:37.026761 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-e8f5f8c1-50f3-4294-8bc4-346f81f56edf tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:37.225683 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-95e868f1-0caa-4543-988f-9c6f910e1dda tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:04:37.226307 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-95e868f1-0caa-4543-988f-9c6f910e1dda tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] [instance: 29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:04:37.235352 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-95e868f1-0caa-4543-988f-9c6f910e1dda tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:37.235812 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-95e868f1-0caa-4543-988f-9c6f910e1dda tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:37.236654 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-95e868f1-0caa-4543-988f-9c6f910e1dda tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:37.237054 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-95e868f1-0caa-4543-988f-9c6f910e1dda tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:37.246437 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-e8f5f8c1-50f3-4294-8bc4-346f81f56edf tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:04:37.255457 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-e8f5f8c1-50f3-4294-8bc4-346f81f56edf tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:04:37.257009 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-e8f5f8c1-50f3-4294-8bc4-346f81f56edf tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:04:37.258193 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-e8f5f8c1-50f3-4294-8bc4-346f81f56edf tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe" status: 200 len: 1731 microversion: 2.20 time: 0.250947 May 26 15:04:37.258758 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 553/1068] 10.222.0.81 () {60 vars in 1277 bytes} [Wed May 26 15:04:37 2021] GET /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe => generated 1731 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:04:37.391388 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-25e84154-2c8d-4fa4-a0a8-de8923c29f4b tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:04:37.392256 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-25e84154-2c8d-4fa4-a0a8-de8923c29f4b tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: 7ad07221-7c50-403d-9d99-8f876d7b7c63] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:04:37.400613 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-25e84154-2c8d-4fa4-a0a8-de8923c29f4b tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:37.401086 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-25e84154-2c8d-4fa4-a0a8-de8923c29f4b tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:37.401934 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-25e84154-2c8d-4fa4-a0a8-de8923c29f4b tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:37.402384 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-25e84154-2c8d-4fa4-a0a8-de8923c29f4b tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:37.461863 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-95e868f1-0caa-4543-988f-9c6f910e1dda tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565618950dd54005a4a040f4dd0cbb33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c65d1e254f424ebfea8360aa697c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:04:37.461863 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-95e868f1-0caa-4543-988f-9c6f910e1dda tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /compute/v2.1/servers/29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de" status: 200 len: 1576 microversion: 2.1 time: 0.234968 May 26 15:04:37.461863 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 516/1069] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:04:37 2021] GET /compute/v2.1/servers/29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de => generated 1576 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:04:37.529796 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-25e84154-2c8d-4fa4-a0a8-de8923c29f4b tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c2fb208b56d4d52b59ac09873f16180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e8cac36a174b2eb5a6e53fdf25b4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:04:37.534186 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-25e84154-2c8d-4fa4-a0a8-de8923c29f4b tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /compute/v2.1/servers/7ad07221-7c50-403d-9d99-8f876d7b7c63" status: 200 len: 1605 microversion: 2.1 time: 0.147054 May 26 15:04:37.534817 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 554/1070] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:04:37 2021] GET /compute/v2.1/servers/7ad07221-7c50-403d-9d99-8f876d7b7c63 => generated 1605 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:04:37.632070 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-dcfe1ec2-c238-40d8-bbc9-40851d898096 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:04:37.632785 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-dcfe1ec2-c238-40d8-bbc9-40851d898096 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] [instance: 40591370-dbd3-45b4-b6c6-a0e01a614c28] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:04:37.641088 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-dcfe1ec2-c238-40d8-bbc9-40851d898096 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:37.641576 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-dcfe1ec2-c238-40d8-bbc9-40851d898096 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:37.642348 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-dcfe1ec2-c238-40d8-bbc9-40851d898096 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:37.642784 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-dcfe1ec2-c238-40d8-bbc9-40851d898096 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:37.855174 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-dcfe1ec2-c238-40d8-bbc9-40851d898096 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf31e2b7edd47c8835741c0dd03b7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83937b4f3831489289cd8aec97222f77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:04:37.864485 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-dcfe1ec2-c238-40d8-bbc9-40851d898096 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] 10.222.0.81 "GET /compute/v2.1/servers/40591370-dbd3-45b4-b6c6-a0e01a614c28" status: 200 len: 1755 microversion: 2.1 time: 0.236180 May 26 15:04:37.865050 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 517/1071] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:04:37 2021] GET /compute/v2.1/servers/40591370-dbd3-45b4-b6c6-a0e01a614c28 => generated 1755 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:04:38.276690 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-59d96cdd-23ed-4036-9aa8-10a9ccd55405 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:04:38.277311 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-59d96cdd-23ed-4036-9aa8-10a9ccd55405 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 757c7def-93df-481f-b40d-7115f4bbbefe] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:04:38.285257 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-59d96cdd-23ed-4036-9aa8-10a9ccd55405 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:38.285754 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-59d96cdd-23ed-4036-9aa8-10a9ccd55405 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:38.286538 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-59d96cdd-23ed-4036-9aa8-10a9ccd55405 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:38.286983 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-59d96cdd-23ed-4036-9aa8-10a9ccd55405 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:38.475044 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-046e0849-a1e2-4c49-ad1b-8fa675da20ad tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:04:38.475664 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-046e0849-a1e2-4c49-ad1b-8fa675da20ad tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] [instance: 29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:04:38.479875 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-59d96cdd-23ed-4036-9aa8-10a9ccd55405 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:04:38.483787 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-046e0849-a1e2-4c49-ad1b-8fa675da20ad tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:38.484280 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-046e0849-a1e2-4c49-ad1b-8fa675da20ad tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:38.485062 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-046e0849-a1e2-4c49-ad1b-8fa675da20ad tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:38.485494 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-046e0849-a1e2-4c49-ad1b-8fa675da20ad tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:38.488737 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-59d96cdd-23ed-4036-9aa8-10a9ccd55405 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:04:38.490294 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-59d96cdd-23ed-4036-9aa8-10a9ccd55405 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:04:38.491427 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-59d96cdd-23ed-4036-9aa8-10a9ccd55405 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe" status: 200 len: 1731 microversion: 2.20 time: 0.218771 May 26 15:04:38.491982 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 555/1072] 10.222.0.81 () {60 vars in 1277 bytes} [Wed May 26 15:04:38 2021] GET /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe => generated 1731 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:04:38.551136 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-f05d020b-38b1-4aca-8a7e-d9824878b7eb tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:04:38.551876 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-f05d020b-38b1-4aca-8a7e-d9824878b7eb tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: 7ad07221-7c50-403d-9d99-8f876d7b7c63] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:04:38.559103 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-f05d020b-38b1-4aca-8a7e-d9824878b7eb tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:38.559556 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-f05d020b-38b1-4aca-8a7e-d9824878b7eb tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:38.560339 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-f05d020b-38b1-4aca-8a7e-d9824878b7eb tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:38.560772 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-f05d020b-38b1-4aca-8a7e-d9824878b7eb tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:38.681003 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-046e0849-a1e2-4c49-ad1b-8fa675da20ad tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565618950dd54005a4a040f4dd0cbb33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c65d1e254f424ebfea8360aa697c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:04:38.681531 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-f05d020b-38b1-4aca-8a7e-d9824878b7eb tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c2fb208b56d4d52b59ac09873f16180', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81e8cac36a174b2eb5a6e53fdf25b4cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:04:38.690139 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-046e0849-a1e2-4c49-ad1b-8fa675da20ad tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /compute/v2.1/servers/29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de" status: 200 len: 1576 microversion: 2.1 time: 0.218902 May 26 15:04:38.690311 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-f05d020b-38b1-4aca-8a7e-d9824878b7eb tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /compute/v2.1/servers/7ad07221-7c50-403d-9d99-8f876d7b7c63" status: 200 len: 1605 microversion: 2.1 time: 0.142968 May 26 15:04:38.690697 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 518/1073] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:04:38 2021] GET /compute/v2.1/servers/29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de => generated 1576 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:04:38.691113 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 556/1074] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:04:38 2021] GET /compute/v2.1/servers/7ad07221-7c50-403d-9d99-8f876d7b7c63 => generated 1605 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:04:38.882228 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-722c628e-29e4-412e-8628-0a5fb3fc338f tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:04:38.882886 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-722c628e-29e4-412e-8628-0a5fb3fc338f tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] [instance: 40591370-dbd3-45b4-b6c6-a0e01a614c28] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:04:38.890302 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-722c628e-29e4-412e-8628-0a5fb3fc338f tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:38.891824 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-722c628e-29e4-412e-8628-0a5fb3fc338f tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:38.892341 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-722c628e-29e4-412e-8628-0a5fb3fc338f tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:38.892832 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-722c628e-29e4-412e-8628-0a5fb3fc338f tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:39.118683 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-722c628e-29e4-412e-8628-0a5fb3fc338f tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf31e2b7edd47c8835741c0dd03b7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83937b4f3831489289cd8aec97222f77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:04:39.126158 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-722c628e-29e4-412e-8628-0a5fb3fc338f tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] 10.222.0.81 "GET /compute/v2.1/servers/40591370-dbd3-45b4-b6c6-a0e01a614c28" status: 200 len: 1755 microversion: 2.1 time: 0.246684 May 26 15:04:39.127502 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 519/1075] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:04:38 2021] GET /compute/v2.1/servers/40591370-dbd3-45b4-b6c6-a0e01a614c28 => generated 1755 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:04:39.510976 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-30ff0cf1-a72c-40d2-ae7a-935901a7a770 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:04:39.512077 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-30ff0cf1-a72c-40d2-ae7a-935901a7a770 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 757c7def-93df-481f-b40d-7115f4bbbefe] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:04:39.521815 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-30ff0cf1-a72c-40d2-ae7a-935901a7a770 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:39.522281 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-30ff0cf1-a72c-40d2-ae7a-935901a7a770 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:39.525156 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-30ff0cf1-a72c-40d2-ae7a-935901a7a770 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:39.525156 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-30ff0cf1-a72c-40d2-ae7a-935901a7a770 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:39.707353 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-b2f15a76-1c6f-4f7f-98f3-1b7cbdda19e5 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:04:39.708122 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-b2f15a76-1c6f-4f7f-98f3-1b7cbdda19e5 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] [instance: 29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:04:39.715524 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-b2f15a76-1c6f-4f7f-98f3-1b7cbdda19e5 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:39.715988 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-b2f15a76-1c6f-4f7f-98f3-1b7cbdda19e5 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:39.716781 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-b2f15a76-1c6f-4f7f-98f3-1b7cbdda19e5 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:39.717224 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-b2f15a76-1c6f-4f7f-98f3-1b7cbdda19e5 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:39.746284 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-30ff0cf1-a72c-40d2-ae7a-935901a7a770 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:04:39.756142 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-30ff0cf1-a72c-40d2-ae7a-935901a7a770 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:04:39.758258 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-30ff0cf1-a72c-40d2-ae7a-935901a7a770 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:04:39.758805 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-30ff0cf1-a72c-40d2-ae7a-935901a7a770 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe" status: 200 len: 1731 microversion: 2.20 time: 0.252369 May 26 15:04:39.759361 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 557/1076] 10.222.0.81 () {60 vars in 1277 bytes} [Wed May 26 15:04:39 2021] GET /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe => generated 1731 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:04:39.763543 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-df7b940d-11c0-424a-96f1-33ae88eaccdd tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:04:39.764153 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-df7b940d-11c0-424a-96f1-33ae88eaccdd tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: 7ad07221-7c50-403d-9d99-8f876d7b7c63] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:04:39.771539 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-df7b940d-11c0-424a-96f1-33ae88eaccdd tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:39.772000 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-df7b940d-11c0-424a-96f1-33ae88eaccdd tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:39.772781 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-df7b940d-11c0-424a-96f1-33ae88eaccdd tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:39.773494 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-df7b940d-11c0-424a-96f1-33ae88eaccdd tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:39.939940 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-b2f15a76-1c6f-4f7f-98f3-1b7cbdda19e5 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565618950dd54005a4a040f4dd0cbb33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c65d1e254f424ebfea8360aa697c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:04:39.948507 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-b2f15a76-1c6f-4f7f-98f3-1b7cbdda19e5 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /compute/v2.1/servers/29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de" status: 200 len: 1576 microversion: 2.1 time: 0.245599 May 26 15:04:39.949002 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 520/1077] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:04:39 2021] GET /compute/v2.1/servers/29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de => generated 1576 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:04:39.968011 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.wsgi [None req-df7b940d-11c0-424a-96f1-33ae88eaccdd tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] HTTP exception thrown: Instance 7ad07221-7c50-403d-9d99-8f876d7b7c63 could not be found. May 26 15:04:39.975776 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-df7b940d-11c0-424a-96f1-33ae88eaccdd tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Returning 404 to user: Instance 7ad07221-7c50-403d-9d99-8f876d7b7c63 could not be found. {{(pid=118513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 26 15:04:39.975776 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-df7b940d-11c0-424a-96f1-33ae88eaccdd tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /compute/v2.1/servers/7ad07221-7c50-403d-9d99-8f876d7b7c63" status: 404 len: 111 microversion: 2.1 time: 0.209251 May 26 15:04:39.975776 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 558/1078] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:04:39 2021] GET /compute/v2.1/servers/7ad07221-7c50-403d-9d99-8f876d7b7c63 => generated 111 bytes in 210 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 15:04:39.982036 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-600b4d38-ed8f-4262-800d-ad0865d2b6e7 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Calling method '.version_select at 0x7f441e49adc0>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:04:40.110951 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-600b4d38-ed8f-4262-800d-ad0865d2b6e7 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-808154170" status: 202 len: 0 microversion: 2.1 time: 0.133324 May 26 15:04:40.111537 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 521/1079] 10.222.0.81 () {58 vars in 1218 bytes} [Wed May 26 15:04:39 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-808154170 => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 15:04:40.147761 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-62b451a9-ab77-4640-bea5-98e0a1892669 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:04:40.148641 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-62b451a9-ab77-4640-bea5-98e0a1892669 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] [instance: 40591370-dbd3-45b4-b6c6-a0e01a614c28] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:04:40.156518 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-62b451a9-ab77-4640-bea5-98e0a1892669 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:40.157173 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-62b451a9-ab77-4640-bea5-98e0a1892669 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:40.158057 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-62b451a9-ab77-4640-bea5-98e0a1892669 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:40.158495 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-62b451a9-ab77-4640-bea5-98e0a1892669 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:40.377306 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-62b451a9-ab77-4640-bea5-98e0a1892669 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf31e2b7edd47c8835741c0dd03b7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83937b4f3831489289cd8aec97222f77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:04:40.386290 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-62b451a9-ab77-4640-bea5-98e0a1892669 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] 10.222.0.81 "GET /compute/v2.1/servers/40591370-dbd3-45b4-b6c6-a0e01a614c28" status: 200 len: 1758 microversion: 2.1 time: 0.242217 May 26 15:04:40.386887 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 559/1080] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:04:40 2021] GET /compute/v2.1/servers/40591370-dbd3-45b4-b6c6-a0e01a614c28 => generated 1758 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:04:40.776493 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-a949d376-b71a-4a19-81db-70b87e3e214f tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:04:40.777030 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-a949d376-b71a-4a19-81db-70b87e3e214f tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 757c7def-93df-481f-b40d-7115f4bbbefe] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:04:40.784699 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-a949d376-b71a-4a19-81db-70b87e3e214f tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:40.785150 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-a949d376-b71a-4a19-81db-70b87e3e214f tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:40.785957 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-a949d376-b71a-4a19-81db-70b87e3e214f tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:40.786394 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-a949d376-b71a-4a19-81db-70b87e3e214f tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:40.966618 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-91e5c73d-88d1-4b62-b99e-c7b963b48061 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:04:40.967251 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-91e5c73d-88d1-4b62-b99e-c7b963b48061 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] [instance: 29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:04:40.976066 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-91e5c73d-88d1-4b62-b99e-c7b963b48061 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:40.976535 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-91e5c73d-88d1-4b62-b99e-c7b963b48061 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:40.977450 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-91e5c73d-88d1-4b62-b99e-c7b963b48061 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:40.978004 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-91e5c73d-88d1-4b62-b99e-c7b963b48061 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:40.991252 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-a949d376-b71a-4a19-81db-70b87e3e214f tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:04:41.000973 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-a949d376-b71a-4a19-81db-70b87e3e214f tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:04:41.002734 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-a949d376-b71a-4a19-81db-70b87e3e214f tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:04:41.003988 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-a949d376-b71a-4a19-81db-70b87e3e214f tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe" status: 200 len: 1731 microversion: 2.20 time: 0.231677 May 26 15:04:41.004668 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 522/1081] 10.222.0.81 () {60 vars in 1277 bytes} [Wed May 26 15:04:40 2021] GET /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe => generated 1731 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:04:41.242936 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-91e5c73d-88d1-4b62-b99e-c7b963b48061 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565618950dd54005a4a040f4dd0cbb33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c65d1e254f424ebfea8360aa697c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:04:41.251938 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-91e5c73d-88d1-4b62-b99e-c7b963b48061 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /compute/v2.1/servers/29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de" status: 200 len: 1563 microversion: 2.1 time: 0.289607 May 26 15:04:41.252999 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 560/1082] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:04:40 2021] GET /compute/v2.1/servers/29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de => generated 1563 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:04:42.022754 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-a6fb3476-1741-4b9f-a143-438353d4359c tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:04:42.023618 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-a6fb3476-1741-4b9f-a143-438353d4359c tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 757c7def-93df-481f-b40d-7115f4bbbefe] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:04:42.030920 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-a6fb3476-1741-4b9f-a143-438353d4359c tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:42.032019 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-a6fb3476-1741-4b9f-a143-438353d4359c tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:42.032801 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-a6fb3476-1741-4b9f-a143-438353d4359c tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:42.033269 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-a6fb3476-1741-4b9f-a143-438353d4359c tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:42.305490 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-a6fb3476-1741-4b9f-a143-438353d4359c tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:04:42.314542 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-a6fb3476-1741-4b9f-a143-438353d4359c tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:04:42.316075 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-a6fb3476-1741-4b9f-a143-438353d4359c tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:04:42.317292 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-a6fb3476-1741-4b9f-a143-438353d4359c tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe" status: 200 len: 1731 microversion: 2.20 time: 0.298592 May 26 15:04:42.317895 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 523/1083] 10.222.0.81 () {60 vars in 1277 bytes} [Wed May 26 15:04:42 2021] GET /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe => generated 1731 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:04:43.336085 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-68799f37-6e93-4b65-b968-87bd261ff305 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:04:43.336709 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-68799f37-6e93-4b65-b968-87bd261ff305 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 757c7def-93df-481f-b40d-7115f4bbbefe] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:04:43.344083 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-68799f37-6e93-4b65-b968-87bd261ff305 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:43.344537 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-68799f37-6e93-4b65-b968-87bd261ff305 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:43.345322 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-68799f37-6e93-4b65-b968-87bd261ff305 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:43.345791 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-68799f37-6e93-4b65-b968-87bd261ff305 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:43.362474 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [req-d834ca22-e3e8-48af-bd40-baf2cad02c7b req-0c4e49f7-95ec-4209-9d71-8a023b06a7df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "757c7def-93df-481f-b40d-7115f4bbbefe", "name": "network-vif-plugged", "status": "completed", "tag": "d9f82690-b757-4c6f-b288-d20d193f4031"}]} {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:04:43.364110 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 15:04:43.364110 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: warnings.warn(msg) May 26 15:04:43.372159 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [req-d834ca22-e3e8-48af-bd40-baf2cad02c7b req-0c4e49f7-95ec-4209-9d71-8a023b06a7df service nova] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:43.372602 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [req-d834ca22-e3e8-48af-bd40-baf2cad02c7b req-0c4e49f7-95ec-4209-9d71-8a023b06a7df service nova] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:43.388610 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.compute.server_external_events [req-d834ca22-e3e8-48af-bd40-baf2cad02c7b req-0c4e49f7-95ec-4209-9d71-8a023b06a7df service nova] Creating event network-vif-plugged:d9f82690-b757-4c6f-b288-d20d193f4031 for instance 757c7def-93df-481f-b40d-7115f4bbbefe on hv-cinder-78414 May 26 15:04:43.394375 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [req-d834ca22-e3e8-48af-bd40-baf2cad02c7b req-0c4e49f7-95ec-4209-9d71-8a023b06a7df service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035649 May 26 15:04:43.394984 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 524/1084] 10.222.0.81 () {64 vars in 1318 bytes} [Wed May 26 15:04:43 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 15:04:43.554950 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-68799f37-6e93-4b65-b968-87bd261ff305 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:04:43.564815 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-68799f37-6e93-4b65-b968-87bd261ff305 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:04:43.566368 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-68799f37-6e93-4b65-b968-87bd261ff305 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:04:43.567523 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-68799f37-6e93-4b65-b968-87bd261ff305 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe" status: 200 len: 1731 microversion: 2.20 time: 0.235391 May 26 15:04:43.568090 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 561/1085] 10.222.0.81 () {60 vars in 1277 bytes} [Wed May 26 15:04:43 2021] GET /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe => generated 1731 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:04:44.362056 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-16196f99-ab00-4cc7-a566-90a54c84412f tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:04:44.362646 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-16196f99-ab00-4cc7-a566-90a54c84412f tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: 7ad07221-7c50-403d-9d99-8f876d7b7c63] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:04:44.370079 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-16196f99-ab00-4cc7-a566-90a54c84412f tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:44.370532 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-16196f99-ab00-4cc7-a566-90a54c84412f tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:44.371308 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-16196f99-ab00-4cc7-a566-90a54c84412f tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:44.371750 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-16196f99-ab00-4cc7-a566-90a54c84412f tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:44.422963 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.wsgi [None req-16196f99-ab00-4cc7-a566-90a54c84412f tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] HTTP exception thrown: Instance 7ad07221-7c50-403d-9d99-8f876d7b7c63 could not be found. May 26 15:04:44.423559 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-16196f99-ab00-4cc7-a566-90a54c84412f tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Returning 404 to user: Instance 7ad07221-7c50-403d-9d99-8f876d7b7c63 could not be found. {{(pid=118514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 26 15:04:44.424384 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-16196f99-ab00-4cc7-a566-90a54c84412f tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "DELETE /compute/v2.1/servers/7ad07221-7c50-403d-9d99-8f876d7b7c63" status: 404 len: 111 microversion: 2.1 time: 0.066500 May 26 15:04:44.424925 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 525/1086] 10.222.0.81 () {58 vars in 1239 bytes} [Wed May 26 15:04:44 2021] DELETE /compute/v2.1/servers/7ad07221-7c50-403d-9d99-8f876d7b7c63 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 15:04:44.432561 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-4db250af-d8b5-41e0-a8b8-be63b2aa5b60 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:04:44.433204 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-4db250af-d8b5-41e0-a8b8-be63b2aa5b60 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: 7ad07221-7c50-403d-9d99-8f876d7b7c63] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:04:44.440348 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-4db250af-d8b5-41e0-a8b8-be63b2aa5b60 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:44.440801 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-4db250af-d8b5-41e0-a8b8-be63b2aa5b60 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:44.441589 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-4db250af-d8b5-41e0-a8b8-be63b2aa5b60 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:44.442028 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-4db250af-d8b5-41e0-a8b8-be63b2aa5b60 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:44.490818 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.wsgi [None req-4db250af-d8b5-41e0-a8b8-be63b2aa5b60 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] HTTP exception thrown: Instance 7ad07221-7c50-403d-9d99-8f876d7b7c63 could not be found. May 26 15:04:44.491410 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-4db250af-d8b5-41e0-a8b8-be63b2aa5b60 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Returning 404 to user: Instance 7ad07221-7c50-403d-9d99-8f876d7b7c63 could not be found. {{(pid=118513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 26 15:04:44.492254 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-4db250af-d8b5-41e0-a8b8-be63b2aa5b60 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /compute/v2.1/servers/7ad07221-7c50-403d-9d99-8f876d7b7c63" status: 404 len: 111 microversion: 2.1 time: 0.063312 May 26 15:04:44.492794 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 562/1087] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:04:44 2021] GET /compute/v2.1/servers/7ad07221-7c50-403d-9d99-8f876d7b7c63 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 15:04:44.586989 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-15016295-c875-4e6f-b338-277dc8600265 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:04:44.587540 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-15016295-c875-4e6f-b338-277dc8600265 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 757c7def-93df-481f-b40d-7115f4bbbefe] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:04:44.595504 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-15016295-c875-4e6f-b338-277dc8600265 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:44.595963 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-15016295-c875-4e6f-b338-277dc8600265 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:44.596745 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-15016295-c875-4e6f-b338-277dc8600265 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:44.597188 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-15016295-c875-4e6f-b338-277dc8600265 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:44.821117 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-15016295-c875-4e6f-b338-277dc8600265 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:04:44.831702 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-15016295-c875-4e6f-b338-277dc8600265 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:04:44.833186 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-15016295-c875-4e6f-b338-277dc8600265 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:04:44.834480 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-15016295-c875-4e6f-b338-277dc8600265 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe" status: 200 len: 1731 microversion: 2.20 time: 0.251237 May 26 15:04:44.835050 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 526/1088] 10.222.0.81 () {60 vars in 1277 bytes} [Wed May 26 15:04:44 2021] GET /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe => generated 1731 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:04:45.852052 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-368381f0-af60-4deb-b824-cb4ab174ac58 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:04:45.852668 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-368381f0-af60-4deb-b824-cb4ab174ac58 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 757c7def-93df-481f-b40d-7115f4bbbefe] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:04:45.863128 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-368381f0-af60-4deb-b824-cb4ab174ac58 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:45.863128 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-368381f0-af60-4deb-b824-cb4ab174ac58 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:45.863128 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-368381f0-af60-4deb-b824-cb4ab174ac58 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:45.863128 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-368381f0-af60-4deb-b824-cb4ab174ac58 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:45.868160 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-7cea7e9d-5dff-4722-b3ae-1744081d6896 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:04:45.868669 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-7cea7e9d-5dff-4722-b3ae-1744081d6896 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: a9d8f9a6-bd66-4caa-8662-4bb94655ae59] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:04:45.876507 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-7cea7e9d-5dff-4722-b3ae-1744081d6896 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:45.876987 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-7cea7e9d-5dff-4722-b3ae-1744081d6896 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:45.877784 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-7cea7e9d-5dff-4722-b3ae-1744081d6896 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:45.878224 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-7cea7e9d-5dff-4722-b3ae-1744081d6896 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:45.927615 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.wsgi [None req-7cea7e9d-5dff-4722-b3ae-1744081d6896 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] HTTP exception thrown: Instance a9d8f9a6-bd66-4caa-8662-4bb94655ae59 could not be found. May 26 15:04:45.928219 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-7cea7e9d-5dff-4722-b3ae-1744081d6896 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Returning 404 to user: Instance a9d8f9a6-bd66-4caa-8662-4bb94655ae59 could not be found. {{(pid=118514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 26 15:04:45.929054 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-7cea7e9d-5dff-4722-b3ae-1744081d6896 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "DELETE /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59" status: 404 len: 111 microversion: 2.1 time: 0.064858 May 26 15:04:45.932517 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 527/1089] 10.222.0.81 () {58 vars in 1239 bytes} [Wed May 26 15:04:45 2021] DELETE /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 15:04:45.937068 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-64b7aba6-f932-4243-9b20-2dccbac90703 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:04:45.937851 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-64b7aba6-f932-4243-9b20-2dccbac90703 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] [instance: a9d8f9a6-bd66-4caa-8662-4bb94655ae59] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:04:45.945198 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-64b7aba6-f932-4243-9b20-2dccbac90703 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:45.945764 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-64b7aba6-f932-4243-9b20-2dccbac90703 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:45.946976 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-64b7aba6-f932-4243-9b20-2dccbac90703 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:45.947106 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-64b7aba6-f932-4243-9b20-2dccbac90703 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:45.996313 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.wsgi [None req-64b7aba6-f932-4243-9b20-2dccbac90703 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] HTTP exception thrown: Instance a9d8f9a6-bd66-4caa-8662-4bb94655ae59 could not be found. May 26 15:04:45.996915 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-64b7aba6-f932-4243-9b20-2dccbac90703 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] Returning 404 to user: Instance a9d8f9a6-bd66-4caa-8662-4bb94655ae59 could not be found. {{(pid=118514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 26 15:04:45.997791 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-64b7aba6-f932-4243-9b20-2dccbac90703 tempest-AttachVolumeTestJSON-1350020850 tempest-AttachVolumeTestJSON-1350020850-project] 10.222.0.81 "GET /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59" status: 404 len: 111 microversion: 2.1 time: 0.064151 May 26 15:04:45.998598 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 528/1090] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:04:45 2021] GET /compute/v2.1/servers/a9d8f9a6-bd66-4caa-8662-4bb94655ae59 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 26 15:04:46.074051 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-368381f0-af60-4deb-b824-cb4ab174ac58 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:04:46.083846 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-368381f0-af60-4deb-b824-cb4ab174ac58 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:04:46.085767 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-368381f0-af60-4deb-b824-cb4ab174ac58 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:04:46.087042 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-368381f0-af60-4deb-b824-cb4ab174ac58 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe" status: 200 len: 1731 microversion: 2.20 time: 0.238760 May 26 15:04:46.087898 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 563/1091] 10.222.0.81 () {60 vars in 1277 bytes} [Wed May 26 15:04:45 2021] GET /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe => generated 1731 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 15:04:47.105955 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-f83bd4ca-64d7-476e-841f-9f60aef35876 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:04:47.106579 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-f83bd4ca-64d7-476e-841f-9f60aef35876 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 757c7def-93df-481f-b40d-7115f4bbbefe] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:04:47.114789 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-f83bd4ca-64d7-476e-841f-9f60aef35876 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:47.115251 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-f83bd4ca-64d7-476e-841f-9f60aef35876 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:47.116033 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-f83bd4ca-64d7-476e-841f-9f60aef35876 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:04:47.116479 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-f83bd4ca-64d7-476e-841f-9f60aef35876 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:04:47.315182 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-f83bd4ca-64d7-476e-841f-9f60aef35876 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:04:47.324090 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-f83bd4ca-64d7-476e-841f-9f60aef35876 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:04:47.325650 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-f83bd4ca-64d7-476e-841f-9f60aef35876 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:04:47.326795 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-f83bd4ca-64d7-476e-841f-9f60aef35876 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe" status: 200 len: 1718 microversion: 2.20 time: 0.224577 May 26 15:04:47.327353 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 529/1092] 10.222.0.81 () {60 vars in 1277 bytes} [Wed May 26 15:04:47 2021] GET /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe => generated 1718 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:05:18.950083 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-a87353f2-fe95-4f4c-a35b-e8702373480e tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-931696345"}} {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:05:18.950680 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-a87353f2-fe95-4f4c-a35b-e8702373480e tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] [instance: 40591370-dbd3-45b4-b6c6-a0e01a614c28] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:05:18.958654 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-a87353f2-fe95-4f4c-a35b-e8702373480e tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:05:18.959177 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-a87353f2-fe95-4f4c-a35b-e8702373480e tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:05:18.959953 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-a87353f2-fe95-4f4c-a35b-e8702373480e tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:05:18.960397 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-a87353f2-fe95-4f4c-a35b-e8702373480e tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:05:19.154172 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.network.security_group_api [None req-a87353f2-fe95-4f4c-a35b-e8702373480e tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Removing security group 26cf896a-b80b-402b-9c0b-61fd0465af2a from port 6431ed44-bb34-4a76-bf6a-5f589562735a May 26 15:05:19.821480 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-a87353f2-fe95-4f4c-a35b-e8702373480e tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] 10.222.0.81 "POST /compute/v2.1/servers/40591370-dbd3-45b4-b6c6-a0e01a614c28/action" status: 202 len: 0 microversion: 2.1 time: 0.875330 May 26 15:05:19.822321 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 564/1093] 10.222.0.81 () {60 vars in 1278 bytes} [Wed May 26 15:05:18 2021] POST /compute/v2.1/servers/40591370-dbd3-45b4-b6c6-a0e01a614c28/action => generated 0 bytes in 877 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 15:05:19.829179 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [req-1c343b01-30e3-4776-b22a-ccb1648492f1 req-553435ba-35ea-4681-b5d0-8906a7615e7c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40591370-dbd3-45b4-b6c6-a0e01a614c28", "tag": "6431ed44-bb34-4a76-bf6a-5f589562735a"}]} {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:05:19.830710 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 15:05:19.830710 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: warnings.warn(msg) May 26 15:05:19.840734 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [req-1c343b01-30e3-4776-b22a-ccb1648492f1 req-553435ba-35ea-4681-b5d0-8906a7615e7c service nova] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:05:19.841370 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [req-1c343b01-30e3-4776-b22a-ccb1648492f1 req-553435ba-35ea-4681-b5d0-8906a7615e7c service nova] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:05:19.861988 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.compute.server_external_events [req-1c343b01-30e3-4776-b22a-ccb1648492f1 req-553435ba-35ea-4681-b5d0-8906a7615e7c service nova] Creating event network-changed:6431ed44-bb34-4a76-bf6a-5f589562735a for instance 40591370-dbd3-45b4-b6c6-a0e01a614c28 on hv-cinder-78414 May 26 15:05:19.874754 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [req-1c343b01-30e3-4776-b22a-ccb1648492f1 req-553435ba-35ea-4681-b5d0-8906a7615e7c service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049091 May 26 15:05:19.875588 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 530/1094] 10.222.0.81 () {64 vars in 1318 bytes} [Wed May 26 15:05:19 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:05:20.458908 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-0a46d474-d670-4b0f-85d6-fe47cfa8fe0e tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:05:20.466339 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-0a46d474-d670-4b0f-85d6-fe47cfa8fe0e tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 757c7def-93df-481f-b40d-7115f4bbbefe] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:05:20.469869 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-0a46d474-d670-4b0f-85d6-fe47cfa8fe0e tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:05:20.470605 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-0a46d474-d670-4b0f-85d6-fe47cfa8fe0e tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:05:20.471653 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-0a46d474-d670-4b0f-85d6-fe47cfa8fe0e tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:05:20.472325 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-0a46d474-d670-4b0f-85d6-fe47cfa8fe0e tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:05:20.548275 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-0a46d474-d670-4b0f-85d6-fe47cfa8fe0e tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 757c7def-93df-481f-b40d-7115f4bbbefe] Going to try to terminate instance {{(pid=118513) delete /opt/stack/nova/nova/compute/api.py:2539}} May 26 15:05:20.869584 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-0a46d474-d670-4b0f-85d6-fe47cfa8fe0e tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "DELETE /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe" status: 204 len: 0 microversion: 2.20 time: 0.414631 May 26 15:05:20.873265 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 565/1095] 10.222.0.81 () {60 vars in 1280 bytes} [Wed May 26 15:05:20 2021] DELETE /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe => generated 0 bytes in 417 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 26 15:05:20.878586 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-40a80f6d-b567-4655-949f-30729c173d76 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:05:20.879294 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-40a80f6d-b567-4655-949f-30729c173d76 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 757c7def-93df-481f-b40d-7115f4bbbefe] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:05:20.887121 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-40a80f6d-b567-4655-949f-30729c173d76 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:05:20.887622 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-40a80f6d-b567-4655-949f-30729c173d76 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:05:20.888416 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-40a80f6d-b567-4655-949f-30729c173d76 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:05:20.888927 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-40a80f6d-b567-4655-949f-30729c173d76 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:05:21.125644 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-40a80f6d-b567-4655-949f-30729c173d76 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:05:21.136157 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-40a80f6d-b567-4655-949f-30729c173d76 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:05:21.138656 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-40a80f6d-b567-4655-949f-30729c173d76 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:05:21.140101 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-40a80f6d-b567-4655-949f-30729c173d76 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe" status: 200 len: 1724 microversion: 2.20 time: 0.265692 May 26 15:05:21.140666 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 531/1096] 10.222.0.81 () {60 vars in 1277 bytes} [Wed May 26 15:05:20 2021] GET /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe => generated 1724 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:05:22.054704 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [req-6eb28e7d-8329-4f44-889e-52e1332738ab req-23259b68-9b0e-476f-916b-29f05c2993e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40591370-dbd3-45b4-b6c6-a0e01a614c28", "tag": "6431ed44-bb34-4a76-bf6a-5f589562735a"}]} {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:05:22.056343 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 15:05:22.056343 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: warnings.warn(msg) May 26 15:05:22.056555 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-0585f699-c6c1-43e8-8122-e3c97495dfa7 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:05:22.057052 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-0585f699-c6c1-43e8-8122-e3c97495dfa7 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] [instance: 40591370-dbd3-45b4-b6c6-a0e01a614c28] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:05:22.065075 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-0585f699-c6c1-43e8-8122-e3c97495dfa7 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:05:22.065291 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [req-6eb28e7d-8329-4f44-889e-52e1332738ab req-23259b68-9b0e-476f-916b-29f05c2993e8 service nova] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:05:22.065525 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [req-6eb28e7d-8329-4f44-889e-52e1332738ab req-23259b68-9b0e-476f-916b-29f05c2993e8 service nova] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:05:22.065936 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-0585f699-c6c1-43e8-8122-e3c97495dfa7 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:05:22.066738 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-0585f699-c6c1-43e8-8122-e3c97495dfa7 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:05:22.067182 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-0585f699-c6c1-43e8-8122-e3c97495dfa7 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:05:22.083350 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.compute.server_external_events [req-6eb28e7d-8329-4f44-889e-52e1332738ab req-23259b68-9b0e-476f-916b-29f05c2993e8 service nova] Creating event network-changed:6431ed44-bb34-4a76-bf6a-5f589562735a for instance 40591370-dbd3-45b4-b6c6-a0e01a614c28 on hv-cinder-78414 May 26 15:05:22.089000 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [req-6eb28e7d-8329-4f44-889e-52e1332738ab req-23259b68-9b0e-476f-916b-29f05c2993e8 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038582 May 26 15:05:22.090265 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 532/1097] 10.222.0.81 () {64 vars in 1318 bytes} [Wed May 26 15:05:22 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:05:22.160659 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-ccfbb614-a579-42c4-b7a7-62f742e65af8 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:05:22.163736 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-ccfbb614-a579-42c4-b7a7-62f742e65af8 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 757c7def-93df-481f-b40d-7115f4bbbefe] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:05:22.172259 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-ccfbb614-a579-42c4-b7a7-62f742e65af8 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:05:22.173933 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-ccfbb614-a579-42c4-b7a7-62f742e65af8 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:05:22.175215 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-ccfbb614-a579-42c4-b7a7-62f742e65af8 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:05:22.176036 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-ccfbb614-a579-42c4-b7a7-62f742e65af8 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:05:22.385640 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.objects.instance [None req-0585f699-c6c1-43e8-8122-e3c97495dfa7 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lazy-loading 'services' on Instance uuid 40591370-dbd3-45b4-b6c6-a0e01a614c28 {{(pid=118513) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 26 15:05:22.785161 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-ccfbb614-a579-42c4-b7a7-62f742e65af8 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:05:22.794443 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-ccfbb614-a579-42c4-b7a7-62f742e65af8 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:05:22.796258 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-ccfbb614-a579-42c4-b7a7-62f742e65af8 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:05:22.797638 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-ccfbb614-a579-42c4-b7a7-62f742e65af8 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe" status: 200 len: 1724 microversion: 2.20 time: 0.641181 May 26 15:05:22.798413 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 533/1098] 10.222.0.81 () {60 vars in 1277 bytes} [Wed May 26 15:05:22 2021] GET /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe => generated 1724 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:05:22.872091 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-0585f699-c6c1-43e8-8122-e3c97495dfa7 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] 10.222.0.81 "DELETE /compute/v2.1/servers/40591370-dbd3-45b4-b6c6-a0e01a614c28/os-volume_attachments/840f87cc-a058-4330-a131-b223fa4f4655" status: 202 len: 0 microversion: 2.1 time: 0.825226 May 26 15:05:22.876359 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 566/1099] 10.222.0.81 () {58 vars in 1416 bytes} [Wed May 26 15:05:22 2021] DELETE /compute/v2.1/servers/40591370-dbd3-45b4-b6c6-a0e01a614c28/os-volume_attachments/840f87cc-a058-4330-a131-b223fa4f4655 => generated 0 bytes in 828 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 15:05:22.884669 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-fcfc72d6-46aa-4795-be4e-3dd3805845b7 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:05:22.886756 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-fcfc72d6-46aa-4795-be4e-3dd3805845b7 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] [instance: 40591370-dbd3-45b4-b6c6-a0e01a614c28] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:05:22.899685 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-fcfc72d6-46aa-4795-be4e-3dd3805845b7 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:05:22.900837 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-fcfc72d6-46aa-4795-be4e-3dd3805845b7 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:05:22.902747 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-fcfc72d6-46aa-4795-be4e-3dd3805845b7 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:05:22.903687 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-fcfc72d6-46aa-4795-be4e-3dd3805845b7 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:05:23.085456 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-fcfc72d6-46aa-4795-be4e-3dd3805845b7 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] 10.222.0.81 "GET /compute/v2.1/servers/40591370-dbd3-45b4-b6c6-a0e01a614c28/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.206936 May 26 15:05:23.087943 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 534/1100] 10.222.0.81 () {58 vars in 1302 bytes} [Wed May 26 15:05:22 2021] GET /compute/v2.1/servers/40591370-dbd3-45b4-b6c6-a0e01a614c28/os-volume_attachments => generated 197 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:05:23.816984 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-2d015801-114c-4264-b312-39936cc73e64 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:05:23.817737 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-2d015801-114c-4264-b312-39936cc73e64 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 757c7def-93df-481f-b40d-7115f4bbbefe] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:05:23.827078 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-2d015801-114c-4264-b312-39936cc73e64 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:05:23.827530 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-2d015801-114c-4264-b312-39936cc73e64 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:05:23.828328 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-2d015801-114c-4264-b312-39936cc73e64 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:05:23.828770 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-2d015801-114c-4264-b312-39936cc73e64 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:05:23.946127 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-2d015801-114c-4264-b312-39936cc73e64 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:05:23.955110 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-2d015801-114c-4264-b312-39936cc73e64 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:05:23.956612 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-2d015801-114c-4264-b312-39936cc73e64 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:05:23.957837 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-2d015801-114c-4264-b312-39936cc73e64 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe" status: 200 len: 1656 microversion: 2.20 time: 0.145096 May 26 15:05:23.958392 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 567/1101] 10.222.0.81 () {60 vars in 1277 bytes} [Wed May 26 15:05:23 2021] GET /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe => generated 1656 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 15:05:24.098773 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-a739e0e2-bc23-46f3-b7bf-4b6ff55d17ad tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:05:24.100607 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-a739e0e2-bc23-46f3-b7bf-4b6ff55d17ad tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] [instance: 40591370-dbd3-45b4-b6c6-a0e01a614c28] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:05:24.108483 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-a739e0e2-bc23-46f3-b7bf-4b6ff55d17ad tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:05:24.108937 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-a739e0e2-bc23-46f3-b7bf-4b6ff55d17ad tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:05:24.109837 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-a739e0e2-bc23-46f3-b7bf-4b6ff55d17ad tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:05:24.110477 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-a739e0e2-bc23-46f3-b7bf-4b6ff55d17ad tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:05:24.187156 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-a739e0e2-bc23-46f3-b7bf-4b6ff55d17ad tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] 10.222.0.81 "GET /compute/v2.1/servers/40591370-dbd3-45b4-b6c6-a0e01a614c28/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.092589 May 26 15:05:24.187944 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 535/1102] 10.222.0.81 () {58 vars in 1302 bytes} [Wed May 26 15:05:24 2021] GET /compute/v2.1/servers/40591370-dbd3-45b4-b6c6-a0e01a614c28/os-volume_attachments => generated 25 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 26 15:05:24.205434 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-a61d9532-a0b3-4c32-aaf9-441bdbf0b811 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:05:24.206134 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-a61d9532-a0b3-4c32-aaf9-441bdbf0b811 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] [instance: 40591370-dbd3-45b4-b6c6-a0e01a614c28] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:05:24.231901 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-a61d9532-a0b3-4c32-aaf9-441bdbf0b811 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:05:24.234536 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-a61d9532-a0b3-4c32-aaf9-441bdbf0b811 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:05:24.235377 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-a61d9532-a0b3-4c32-aaf9-441bdbf0b811 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:05:24.235834 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-a61d9532-a0b3-4c32-aaf9-441bdbf0b811 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:05:24.294912 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [req-6fa526c3-cf69-43d4-b7b9-fb83a1ab85f9 req-611f25b4-fa4b-4f17-9c99-5bfcf9501496 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "757c7def-93df-481f-b40d-7115f4bbbefe", "name": "network-vif-deleted", "tag": "d9f82690-b757-4c6f-b288-d20d193f4031"}]} {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:05:24.297002 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 15:05:24.297002 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: warnings.warn(msg) May 26 15:05:24.307754 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [req-6fa526c3-cf69-43d4-b7b9-fb83a1ab85f9 req-611f25b4-fa4b-4f17-9c99-5bfcf9501496 service nova] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:05:24.308278 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [req-6fa526c3-cf69-43d4-b7b9-fb83a1ab85f9 req-611f25b4-fa4b-4f17-9c99-5bfcf9501496 service nova] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:05:24.326419 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.compute.server_external_events [req-6fa526c3-cf69-43d4-b7b9-fb83a1ab85f9 req-611f25b4-fa4b-4f17-9c99-5bfcf9501496 service nova] Creating event network-vif-deleted:d9f82690-b757-4c6f-b288-d20d193f4031 for instance 757c7def-93df-481f-b40d-7115f4bbbefe on hv-cinder-78414 May 26 15:05:24.331019 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [req-6fa526c3-cf69-43d4-b7b9-fb83a1ab85f9 req-611f25b4-fa4b-4f17-9c99-5bfcf9501496 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040168 May 26 15:05:24.331709 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 536/1103] 10.222.0.81 () {64 vars in 1318 bytes} [Wed May 26 15:05:24 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 15:05:24.416403 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.wsgi [None req-a61d9532-a0b3-4c32-aaf9-441bdbf0b811 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] HTTP exception thrown: Instance 40591370-dbd3-45b4-b6c6-a0e01a614c28 is not attached to volume 840f87cc-a058-4330-a131-b223fa4f4655 May 26 15:05:24.417107 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-a61d9532-a0b3-4c32-aaf9-441bdbf0b811 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Returning 404 to user: Instance 40591370-dbd3-45b4-b6c6-a0e01a614c28 is not attached to volume 840f87cc-a058-4330-a131-b223fa4f4655 {{(pid=118513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 26 15:05:24.419020 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-a61d9532-a0b3-4c32-aaf9-441bdbf0b811 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] 10.222.0.81 "DELETE /compute/v2.1/servers/40591370-dbd3-45b4-b6c6-a0e01a614c28/os-volume_attachments/840f87cc-a058-4330-a131-b223fa4f4655" status: 404 len: 154 microversion: 2.1 time: 0.216733 May 26 15:05:24.419020 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 568/1104] 10.222.0.81 () {58 vars in 1416 bytes} [Wed May 26 15:05:24 2021] DELETE /compute/v2.1/servers/40591370-dbd3-45b4-b6c6-a0e01a614c28/os-volume_attachments/840f87cc-a058-4330-a131-b223fa4f4655 => generated 154 bytes in 218 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 15:05:24.977876 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-d5efcdd8-2c47-42a1-97cf-0b699ca7fde8 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:05:24.978880 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-d5efcdd8-2c47-42a1-97cf-0b699ca7fde8 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 757c7def-93df-481f-b40d-7115f4bbbefe] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:05:24.987652 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-d5efcdd8-2c47-42a1-97cf-0b699ca7fde8 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:05:24.988160 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-d5efcdd8-2c47-42a1-97cf-0b699ca7fde8 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:05:24.989146 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-d5efcdd8-2c47-42a1-97cf-0b699ca7fde8 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:05:24.989642 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-d5efcdd8-2c47-42a1-97cf-0b699ca7fde8 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:05:25.068676 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-d5efcdd8-2c47-42a1-97cf-0b699ca7fde8 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:05:25.069221 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-d5efcdd8-2c47-42a1-97cf-0b699ca7fde8 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:05:25.069731 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.objects.instance [None req-d5efcdd8-2c47-42a1-97cf-0b699ca7fde8 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lazy-loading 'fault' on Instance uuid 757c7def-93df-481f-b40d-7115f4bbbefe {{(pid=118514) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 26 15:05:25.261331 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-d5efcdd8-2c47-42a1-97cf-0b699ca7fde8 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:05:25.275823 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-d5efcdd8-2c47-42a1-97cf-0b699ca7fde8 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:05:25.278216 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-d5efcdd8-2c47-42a1-97cf-0b699ca7fde8 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de739c6952a94c308a9cc89c738d8500', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7555f6895a2a405685d8ccfe81fe5a74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:05:25.280130 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-d5efcdd8-2c47-42a1-97cf-0b699ca7fde8 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe" status: 200 len: 1371 microversion: 2.20 time: 0.307416 May 26 15:05:25.283302 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 537/1105] 10.222.0.81 () {60 vars in 1277 bytes} [Wed May 26 15:05:24 2021] GET /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe => generated 1371 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 15:05:25.807815 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-b8b642e5-f26b-430b-9754-f52aaafa0084 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:05:25.808738 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-b8b642e5-f26b-430b-9754-f52aaafa0084 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] [instance: 40591370-dbd3-45b4-b6c6-a0e01a614c28] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:05:25.816422 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-b8b642e5-f26b-430b-9754-f52aaafa0084 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:05:25.816899 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-b8b642e5-f26b-430b-9754-f52aaafa0084 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:05:25.818101 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-b8b642e5-f26b-430b-9754-f52aaafa0084 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:05:25.818842 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-b8b642e5-f26b-430b-9754-f52aaafa0084 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:05:25.880920 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-b8b642e5-f26b-430b-9754-f52aaafa0084 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] [instance: 40591370-dbd3-45b4-b6c6-a0e01a614c28] Going to try to terminate instance {{(pid=118513) delete /opt/stack/nova/nova/compute/api.py:2539}} May 26 15:05:26.302214 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-6d4479cb-bf11-406a-a4e2-6b48bf2e63fe tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:05:26.303278 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-6d4479cb-bf11-406a-a4e2-6b48bf2e63fe tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 757c7def-93df-481f-b40d-7115f4bbbefe] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:05:26.310533 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-6d4479cb-bf11-406a-a4e2-6b48bf2e63fe tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:05:26.310991 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-6d4479cb-bf11-406a-a4e2-6b48bf2e63fe tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:05:26.311766 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-6d4479cb-bf11-406a-a4e2-6b48bf2e63fe tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:05:26.312255 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-6d4479cb-bf11-406a-a4e2-6b48bf2e63fe tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:05:26.366815 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.wsgi [None req-6d4479cb-bf11-406a-a4e2-6b48bf2e63fe tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] HTTP exception thrown: Instance 757c7def-93df-481f-b40d-7115f4bbbefe could not be found. May 26 15:05:26.367344 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-6d4479cb-bf11-406a-a4e2-6b48bf2e63fe tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Returning 404 to user: Instance 757c7def-93df-481f-b40d-7115f4bbbefe could not be found. {{(pid=118514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 26 15:05:26.368183 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-6d4479cb-bf11-406a-a4e2-6b48bf2e63fe tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe" status: 404 len: 111 microversion: 2.20 time: 0.069939 May 26 15:05:26.368736 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 538/1106] 10.222.0.81 () {60 vars in 1277 bytes} [Wed May 26 15:05:26 2021] GET /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) May 26 15:05:26.376534 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-4a937506-2475-4b25-b2ab-70c715cf3396 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Calling method '.version_select at 0x7f441e1db940>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:05:26.383891 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-b8b642e5-f26b-430b-9754-f52aaafa0084 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] 10.222.0.81 "DELETE /compute/v2.1/servers/40591370-dbd3-45b4-b6c6-a0e01a614c28" status: 204 len: 0 microversion: 2.1 time: 0.579896 May 26 15:05:26.384580 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 569/1107] 10.222.0.81 () {58 vars in 1239 bytes} [Wed May 26 15:05:25 2021] DELETE /compute/v2.1/servers/40591370-dbd3-45b4-b6c6-a0e01a614c28 => generated 0 bytes in 582 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 15:05:26.400685 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-3238f7ec-a67a-4a5b-8d56-e293f4df9858 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:05:26.401378 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-3238f7ec-a67a-4a5b-8d56-e293f4df9858 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] [instance: 40591370-dbd3-45b4-b6c6-a0e01a614c28] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:05:26.408685 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-3238f7ec-a67a-4a5b-8d56-e293f4df9858 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:05:26.409137 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-3238f7ec-a67a-4a5b-8d56-e293f4df9858 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:05:26.410019 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-3238f7ec-a67a-4a5b-8d56-e293f4df9858 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:05:26.410463 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-3238f7ec-a67a-4a5b-8d56-e293f4df9858 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:05:26.487395 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-4a937506-2475-4b25-b2ab-70c715cf3396 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1380492548" status: 204 len: 0 microversion: 2.20 time: 0.114182 May 26 15:05:26.487982 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 539/1108] 10.222.0.81 () {60 vars in 1262 bytes} [Wed May 26 15:05:26 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1380492548 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) May 26 15:05:26.669196 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-3238f7ec-a67a-4a5b-8d56-e293f4df9858 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf31e2b7edd47c8835741c0dd03b7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83937b4f3831489289cd8aec97222f77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:05:26.677346 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-3238f7ec-a67a-4a5b-8d56-e293f4df9858 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] 10.222.0.81 "GET /compute/v2.1/servers/40591370-dbd3-45b4-b6c6-a0e01a614c28" status: 200 len: 1553 microversion: 2.1 time: 0.281836 May 26 15:05:26.677928 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 570/1109] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:05:26 2021] GET /compute/v2.1/servers/40591370-dbd3-45b4-b6c6-a0e01a614c28 => generated 1553 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:05:27.694142 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-0314286b-d80c-4028-a31d-504f794cedca tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:05:27.694891 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-0314286b-d80c-4028-a31d-504f794cedca tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] [instance: 40591370-dbd3-45b4-b6c6-a0e01a614c28] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:05:27.702234 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-0314286b-d80c-4028-a31d-504f794cedca tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:05:27.706173 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-0314286b-d80c-4028-a31d-504f794cedca tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:05:27.706173 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-0314286b-d80c-4028-a31d-504f794cedca tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:05:27.706173 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-0314286b-d80c-4028-a31d-504f794cedca tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:05:28.152283 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-0314286b-d80c-4028-a31d-504f794cedca tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf31e2b7edd47c8835741c0dd03b7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83937b4f3831489289cd8aec97222f77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:05:28.161208 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-0314286b-d80c-4028-a31d-504f794cedca tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] 10.222.0.81 "GET /compute/v2.1/servers/40591370-dbd3-45b4-b6c6-a0e01a614c28" status: 200 len: 1553 microversion: 2.1 time: 0.470765 May 26 15:05:28.162237 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 540/1110] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:05:27 2021] GET /compute/v2.1/servers/40591370-dbd3-45b4-b6c6-a0e01a614c28 => generated 1553 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:05:28.959852 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [req-45a4df3b-a172-41fd-a4f1-a4e15bb2c34c req-d637e2c2-a5c1-4fd1-9e23-dd86d8d16459 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40591370-dbd3-45b4-b6c6-a0e01a614c28", "name": "network-vif-deleted", "tag": "6431ed44-bb34-4a76-bf6a-5f589562735a"}]} {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:05:28.961735 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 15:05:28.961735 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: warnings.warn(msg) May 26 15:05:28.970073 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [req-45a4df3b-a172-41fd-a4f1-a4e15bb2c34c req-d637e2c2-a5c1-4fd1-9e23-dd86d8d16459 service nova] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:05:28.981204 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [req-45a4df3b-a172-41fd-a4f1-a4e15bb2c34c req-d637e2c2-a5c1-4fd1-9e23-dd86d8d16459 service nova] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:05:28.990644 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.compute.server_external_events [req-45a4df3b-a172-41fd-a4f1-a4e15bb2c34c req-d637e2c2-a5c1-4fd1-9e23-dd86d8d16459 service nova] Creating event network-vif-deleted:6431ed44-bb34-4a76-bf6a-5f589562735a for instance 40591370-dbd3-45b4-b6c6-a0e01a614c28 on hv-cinder-78414 May 26 15:05:28.995667 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [req-45a4df3b-a172-41fd-a4f1-a4e15bb2c34c req-d637e2c2-a5c1-4fd1-9e23-dd86d8d16459 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039672 May 26 15:05:28.996450 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 571/1111] 10.222.0.81 () {64 vars in 1318 bytes} [Wed May 26 15:05:28 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 15:05:29.165516 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-9c451bc9-722e-498a-9cae-dbe2da66876d tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:05:29.166100 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-9c451bc9-722e-498a-9cae-dbe2da66876d tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 757c7def-93df-481f-b40d-7115f4bbbefe] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:05:29.175116 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-9c451bc9-722e-498a-9cae-dbe2da66876d tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:05:29.175674 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-9c451bc9-722e-498a-9cae-dbe2da66876d tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:05:29.176465 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-9c451bc9-722e-498a-9cae-dbe2da66876d tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:05:29.176900 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-9c451bc9-722e-498a-9cae-dbe2da66876d tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:05:29.179933 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-94fbc5f8-ec42-46ed-9116-dc88e35d2250 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:05:29.181082 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-94fbc5f8-ec42-46ed-9116-dc88e35d2250 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] [instance: 40591370-dbd3-45b4-b6c6-a0e01a614c28] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:05:29.191336 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-94fbc5f8-ec42-46ed-9116-dc88e35d2250 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:05:29.192179 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-94fbc5f8-ec42-46ed-9116-dc88e35d2250 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:05:29.193516 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-94fbc5f8-ec42-46ed-9116-dc88e35d2250 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:05:29.194391 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-94fbc5f8-ec42-46ed-9116-dc88e35d2250 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:05:29.235021 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.wsgi [None req-9c451bc9-722e-498a-9cae-dbe2da66876d tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] HTTP exception thrown: Instance 757c7def-93df-481f-b40d-7115f4bbbefe could not be found. May 26 15:05:29.235636 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-9c451bc9-722e-498a-9cae-dbe2da66876d tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Returning 404 to user: Instance 757c7def-93df-481f-b40d-7115f4bbbefe could not be found. {{(pid=118514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 26 15:05:29.236490 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-9c451bc9-722e-498a-9cae-dbe2da66876d tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "DELETE /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe" status: 404 len: 111 microversion: 2.1 time: 0.075300 May 26 15:05:29.237059 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 541/1112] 10.222.0.81 () {58 vars in 1239 bytes} [Wed May 26 15:05:29 2021] DELETE /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 15:05:29.244797 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-d488446d-d72f-4734-9ded-cbec5a2636a3 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:05:29.245423 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-d488446d-d72f-4734-9ded-cbec5a2636a3 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 757c7def-93df-481f-b40d-7115f4bbbefe] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:05:29.253010 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-d488446d-d72f-4734-9ded-cbec5a2636a3 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:05:29.253470 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-d488446d-d72f-4734-9ded-cbec5a2636a3 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:05:29.254317 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-d488446d-d72f-4734-9ded-cbec5a2636a3 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:05:29.254765 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-d488446d-d72f-4734-9ded-cbec5a2636a3 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:05:29.310941 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.wsgi [None req-d488446d-d72f-4734-9ded-cbec5a2636a3 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] HTTP exception thrown: Instance 757c7def-93df-481f-b40d-7115f4bbbefe could not be found. May 26 15:05:29.311814 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-d488446d-d72f-4734-9ded-cbec5a2636a3 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Returning 404 to user: Instance 757c7def-93df-481f-b40d-7115f4bbbefe could not be found. {{(pid=118514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 26 15:05:29.313101 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-d488446d-d72f-4734-9ded-cbec5a2636a3 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe" status: 404 len: 111 microversion: 2.1 time: 0.071911 May 26 15:05:29.313875 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 542/1113] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:05:29 2021] GET /compute/v2.1/servers/757c7def-93df-481f-b40d-7115f4bbbefe => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 26 15:05:29.329289 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-94fbc5f8-ec42-46ed-9116-dc88e35d2250 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdf31e2b7edd47c8835741c0dd03b7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83937b4f3831489289cd8aec97222f77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:05:29.339516 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-94fbc5f8-ec42-46ed-9116-dc88e35d2250 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] 10.222.0.81 "GET /compute/v2.1/servers/40591370-dbd3-45b4-b6c6-a0e01a614c28" status: 200 len: 1343 microversion: 2.1 time: 0.164401 May 26 15:05:29.340299 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 572/1114] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:05:29 2021] GET /compute/v2.1/servers/40591370-dbd3-45b4-b6c6-a0e01a614c28 => generated 1343 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:05:30.356323 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-dfc6f5f4-59ef-4d9e-8d8f-adaf4da3f118 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:05:30.356970 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-dfc6f5f4-59ef-4d9e-8d8f-adaf4da3f118 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] [instance: 40591370-dbd3-45b4-b6c6-a0e01a614c28] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:05:30.364147 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-dfc6f5f4-59ef-4d9e-8d8f-adaf4da3f118 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:05:30.364605 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-dfc6f5f4-59ef-4d9e-8d8f-adaf4da3f118 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:05:30.366227 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-dfc6f5f4-59ef-4d9e-8d8f-adaf4da3f118 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:05:30.366686 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-dfc6f5f4-59ef-4d9e-8d8f-adaf4da3f118 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:05:30.418834 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.wsgi [None req-dfc6f5f4-59ef-4d9e-8d8f-adaf4da3f118 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] HTTP exception thrown: Instance 40591370-dbd3-45b4-b6c6-a0e01a614c28 could not be found. May 26 15:05:30.419430 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-dfc6f5f4-59ef-4d9e-8d8f-adaf4da3f118 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Returning 404 to user: Instance 40591370-dbd3-45b4-b6c6-a0e01a614c28 could not be found. {{(pid=118514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 26 15:05:30.420260 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-dfc6f5f4-59ef-4d9e-8d8f-adaf4da3f118 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] 10.222.0.81 "GET /compute/v2.1/servers/40591370-dbd3-45b4-b6c6-a0e01a614c28" status: 404 len: 111 microversion: 2.1 time: 0.067811 May 26 15:05:30.420812 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 543/1115] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:05:30 2021] GET /compute/v2.1/servers/40591370-dbd3-45b4-b6c6-a0e01a614c28 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 15:05:30.429569 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-8f384de6-5f74-4f7d-936f-d773099737b8 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] Calling method '.version_select at 0x7f441d9301f0>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:05:30.514857 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-8f384de6-5f74-4f7d-936f-d773099737b8 tempest-TestMinimumBasicScenario-2043119393 tempest-TestMinimumBasicScenario-2043119393-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-655383652" status: 202 len: 0 microversion: 2.1 time: 0.089486 May 26 15:05:30.515351 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 573/1116] 10.222.0.81 () {58 vars in 1269 bytes} [Wed May 26 15:05:30 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-655383652 => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 15:05:30.756740 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-91d6c88d-7739-4b83-97e5-07c224eb627f tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:05:30.757253 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-91d6c88d-7739-4b83-97e5-07c224eb627f tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 598b0e3f-8cf1-451a-80a8-ed7e5dd36984] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:05:30.764543 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-91d6c88d-7739-4b83-97e5-07c224eb627f tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:05:30.765063 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-91d6c88d-7739-4b83-97e5-07c224eb627f tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:05:30.765815 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-91d6c88d-7739-4b83-97e5-07c224eb627f tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:05:30.766261 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-91d6c88d-7739-4b83-97e5-07c224eb627f tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:05:30.816060 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.wsgi [None req-91d6c88d-7739-4b83-97e5-07c224eb627f tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] HTTP exception thrown: Instance 598b0e3f-8cf1-451a-80a8-ed7e5dd36984 could not be found. May 26 15:05:30.816668 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-91d6c88d-7739-4b83-97e5-07c224eb627f tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Returning 404 to user: Instance 598b0e3f-8cf1-451a-80a8-ed7e5dd36984 could not be found. {{(pid=118514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 26 15:05:30.817514 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-91d6c88d-7739-4b83-97e5-07c224eb627f tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "DELETE /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984" status: 404 len: 111 microversion: 2.1 time: 0.064482 May 26 15:05:30.818166 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 544/1117] 10.222.0.81 () {58 vars in 1239 bytes} [Wed May 26 15:05:30 2021] DELETE /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 15:05:30.826012 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-31e087d4-c2ae-49cd-ad66-81469c8495e6 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:05:30.826634 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-31e087d4-c2ae-49cd-ad66-81469c8495e6 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] [instance: 598b0e3f-8cf1-451a-80a8-ed7e5dd36984] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:05:30.834360 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-31e087d4-c2ae-49cd-ad66-81469c8495e6 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:05:30.834822 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-31e087d4-c2ae-49cd-ad66-81469c8495e6 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:05:30.835602 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-31e087d4-c2ae-49cd-ad66-81469c8495e6 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:05:30.836051 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-31e087d4-c2ae-49cd-ad66-81469c8495e6 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:05:30.884570 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.wsgi [None req-31e087d4-c2ae-49cd-ad66-81469c8495e6 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] HTTP exception thrown: Instance 598b0e3f-8cf1-451a-80a8-ed7e5dd36984 could not be found. May 26 15:05:30.885179 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-31e087d4-c2ae-49cd-ad66-81469c8495e6 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] Returning 404 to user: Instance 598b0e3f-8cf1-451a-80a8-ed7e5dd36984 could not be found. {{(pid=118513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 26 15:05:30.886085 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-31e087d4-c2ae-49cd-ad66-81469c8495e6 tempest-AttachVolumeShelveTestJSON-1489584742 tempest-AttachVolumeShelveTestJSON-1489584742-project] 10.222.0.81 "GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984" status: 404 len: 111 microversion: 2.1 time: 0.063774 May 26 15:05:30.886616 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 574/1118] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:05:30 2021] GET /compute/v2.1/servers/598b0e3f-8cf1-451a-80a8-ed7e5dd36984 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 15:06:01.700923 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-e4c03e0f-9400-4a53-910a-c58fa15197cf tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:06:01.701491 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-e4c03e0f-9400-4a53-910a-c58fa15197cf tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] [instance: 29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:06:01.703357 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [req-7cfc7d5e-9979-4749-a0a8-fdea93e7b4fa req-fdf87497-27ad-4178-be05-39cc52379727 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de", "tag": "24388d3c-fd02-41f5-996a-da7452902c2b"}]} {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:06:01.704864 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 15:06:01.704864 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: warnings.warn(msg) May 26 15:06:01.711210 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-e4c03e0f-9400-4a53-910a-c58fa15197cf tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:06:01.712157 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-e4c03e0f-9400-4a53-910a-c58fa15197cf tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:06:01.713126 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-e4c03e0f-9400-4a53-910a-c58fa15197cf tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:06:01.713768 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-e4c03e0f-9400-4a53-910a-c58fa15197cf tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:06:01.716820 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [req-7cfc7d5e-9979-4749-a0a8-fdea93e7b4fa req-fdf87497-27ad-4178-be05-39cc52379727 service nova] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:06:01.717281 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [req-7cfc7d5e-9979-4749-a0a8-fdea93e7b4fa req-fdf87497-27ad-4178-be05-39cc52379727 service nova] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:06:01.735866 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.compute.server_external_events [req-7cfc7d5e-9979-4749-a0a8-fdea93e7b4fa req-fdf87497-27ad-4178-be05-39cc52379727 service nova] Creating event network-changed:24388d3c-fd02-41f5-996a-da7452902c2b for instance 29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de on hv-cinder-78414 May 26 15:06:01.742211 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [req-7cfc7d5e-9979-4749-a0a8-fdea93e7b4fa req-fdf87497-27ad-4178-be05-39cc52379727 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041331 May 26 15:06:01.745202 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 575/1119] 10.222.0.81 () {64 vars in 1318 bytes} [Wed May 26 15:06:01 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:06:01.781765 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-e4c03e0f-9400-4a53-910a-c58fa15197cf tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] [instance: 29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de] Going to try to terminate instance {{(pid=118514) delete /opt/stack/nova/nova/compute/api.py:2539}} May 26 15:06:02.160552 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-e4c03e0f-9400-4a53-910a-c58fa15197cf tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "DELETE /compute/v2.1/servers/29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de" status: 204 len: 0 microversion: 2.1 time: 0.463032 May 26 15:06:02.161148 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 545/1120] 10.222.0.81 () {58 vars in 1239 bytes} [Wed May 26 15:06:01 2021] DELETE /compute/v2.1/servers/29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de => generated 0 bytes in 465 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 15:06:02.171775 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-bbdce148-6ddf-4f9d-b0d3-6d5ce4686418 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:06:02.172384 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-bbdce148-6ddf-4f9d-b0d3-6d5ce4686418 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] [instance: 29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:06:02.183420 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-bbdce148-6ddf-4f9d-b0d3-6d5ce4686418 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:06:02.184017 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-bbdce148-6ddf-4f9d-b0d3-6d5ce4686418 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:06:02.184826 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-bbdce148-6ddf-4f9d-b0d3-6d5ce4686418 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:06:02.185268 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-bbdce148-6ddf-4f9d-b0d3-6d5ce4686418 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:06:02.450485 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-bbdce148-6ddf-4f9d-b0d3-6d5ce4686418 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565618950dd54005a4a040f4dd0cbb33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c65d1e254f424ebfea8360aa697c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:06:02.466359 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-bbdce148-6ddf-4f9d-b0d3-6d5ce4686418 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /compute/v2.1/servers/29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de" status: 200 len: 1569 microversion: 2.1 time: 0.299437 May 26 15:06:02.481335 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 576/1121] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:06:02 2021] GET /compute/v2.1/servers/29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de => generated 1569 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:06:03.484754 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-ad702e16-4d54-4e33-8414-1783a2d33666 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:06:03.485495 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-ad702e16-4d54-4e33-8414-1783a2d33666 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] [instance: 29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:06:03.493415 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-ad702e16-4d54-4e33-8414-1783a2d33666 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:06:03.493904 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-ad702e16-4d54-4e33-8414-1783a2d33666 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:06:03.494684 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-ad702e16-4d54-4e33-8414-1783a2d33666 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:06:03.495138 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-ad702e16-4d54-4e33-8414-1783a2d33666 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:06:03.785634 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-ad702e16-4d54-4e33-8414-1783a2d33666 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565618950dd54005a4a040f4dd0cbb33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c65d1e254f424ebfea8360aa697c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:06:03.794065 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-ad702e16-4d54-4e33-8414-1783a2d33666 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /compute/v2.1/servers/29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de" status: 200 len: 1451 microversion: 2.1 time: 0.313418 May 26 15:06:03.794636 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 546/1122] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:06:03 2021] GET /compute/v2.1/servers/29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de => generated 1451 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:06:04.660435 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [req-8e7cbafc-31d7-4687-bc4f-c897f1ae3653 req-d73bf79c-e4fc-421b-a31f-43010c07abf8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de", "name": "network-vif-deleted", "tag": "24388d3c-fd02-41f5-996a-da7452902c2b"}]} {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:06:04.662228 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 15:06:04.662228 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: warnings.warn(msg) May 26 15:06:04.670704 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [req-8e7cbafc-31d7-4687-bc4f-c897f1ae3653 req-d73bf79c-e4fc-421b-a31f-43010c07abf8 service nova] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:06:04.676342 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [req-8e7cbafc-31d7-4687-bc4f-c897f1ae3653 req-d73bf79c-e4fc-421b-a31f-43010c07abf8 service nova] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:06:04.687482 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.compute.server_external_events [req-8e7cbafc-31d7-4687-bc4f-c897f1ae3653 req-d73bf79c-e4fc-421b-a31f-43010c07abf8 service nova] Creating event network-vif-deleted:24388d3c-fd02-41f5-996a-da7452902c2b for instance 29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de on hv-cinder-78414 May 26 15:06:04.692227 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [req-8e7cbafc-31d7-4687-bc4f-c897f1ae3653 req-d73bf79c-e4fc-421b-a31f-43010c07abf8 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035451 May 26 15:06:04.692996 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 577/1123] 10.222.0.81 () {64 vars in 1318 bytes} [Wed May 26 15:06:04 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:06:04.811429 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-ed852fb7-0811-41da-868d-368175ef2317 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:06:04.812055 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-ed852fb7-0811-41da-868d-368175ef2317 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] [instance: 29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:06:04.820411 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-ed852fb7-0811-41da-868d-368175ef2317 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:06:04.820803 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-ed852fb7-0811-41da-868d-368175ef2317 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:06:04.821842 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-ed852fb7-0811-41da-868d-368175ef2317 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:06:04.822294 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-ed852fb7-0811-41da-868d-368175ef2317 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:06:05.047528 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-ed852fb7-0811-41da-868d-368175ef2317 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565618950dd54005a4a040f4dd0cbb33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c65d1e254f424ebfea8360aa697c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:06:05.056807 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-ed852fb7-0811-41da-868d-368175ef2317 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /compute/v2.1/servers/29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de" status: 200 len: 1220 microversion: 2.1 time: 0.249235 May 26 15:06:05.057371 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 547/1124] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:06:04 2021] GET /compute/v2.1/servers/29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de => generated 1220 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:06:06.073995 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-c6f8d5de-3f17-41cc-a25a-5cea8eccbdba tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:06:06.074707 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-c6f8d5de-3f17-41cc-a25a-5cea8eccbdba tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] [instance: 29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:06:06.082372 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-c6f8d5de-3f17-41cc-a25a-5cea8eccbdba tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:06:06.082840 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-c6f8d5de-3f17-41cc-a25a-5cea8eccbdba tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:06:06.083633 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-c6f8d5de-3f17-41cc-a25a-5cea8eccbdba tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:06:06.084077 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-c6f8d5de-3f17-41cc-a25a-5cea8eccbdba tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:06:06.156309 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-c6f8d5de-3f17-41cc-a25a-5cea8eccbdba tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:06:06.156762 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-c6f8d5de-3f17-41cc-a25a-5cea8eccbdba tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:06:06.157224 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.objects.instance [None req-c6f8d5de-3f17-41cc-a25a-5cea8eccbdba tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lazy-loading 'fault' on Instance uuid 29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de {{(pid=118513) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 26 15:06:06.215870 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-c6f8d5de-3f17-41cc-a25a-5cea8eccbdba tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '565618950dd54005a4a040f4dd0cbb33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c65d1e254f424ebfea8360aa697c34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:06:06.224996 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-c6f8d5de-3f17-41cc-a25a-5cea8eccbdba tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /compute/v2.1/servers/29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de" status: 200 len: 1225 microversion: 2.1 time: 0.155064 May 26 15:06:06.225587 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 578/1125] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:06:06 2021] GET /compute/v2.1/servers/29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de => generated 1225 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:06:07.242867 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-cdb16656-b3ba-4ee4-a5d0-12aa6a32f639 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:06:07.243490 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-cdb16656-b3ba-4ee4-a5d0-12aa6a32f639 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] [instance: 29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:06:07.250939 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-cdb16656-b3ba-4ee4-a5d0-12aa6a32f639 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:06:07.251378 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-cdb16656-b3ba-4ee4-a5d0-12aa6a32f639 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:06:07.252164 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-cdb16656-b3ba-4ee4-a5d0-12aa6a32f639 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:06:07.252610 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-cdb16656-b3ba-4ee4-a5d0-12aa6a32f639 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:06:07.302591 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.wsgi [None req-cdb16656-b3ba-4ee4-a5d0-12aa6a32f639 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] HTTP exception thrown: Instance 29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de could not be found. May 26 15:06:07.303196 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-cdb16656-b3ba-4ee4-a5d0-12aa6a32f639 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Returning 404 to user: Instance 29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de could not be found. {{(pid=118514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 26 15:06:07.304338 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-cdb16656-b3ba-4ee4-a5d0-12aa6a32f639 tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "GET /compute/v2.1/servers/29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de" status: 404 len: 111 microversion: 2.1 time: 0.065872 May 26 15:06:07.304923 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 548/1126] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:06:07 2021] GET /compute/v2.1/servers/29e78d23-d5cc-4dac-a2be-9f9ca3a0a1de => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 15:06:07.651976 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-0ca828db-42a0-45c6-ba14-d885fef1dadb tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] Calling method '.version_select at 0x7f441d9d4f70>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:06:07.738245 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-0ca828db-42a0-45c6-ba14-d885fef1dadb tempest-TestShelveInstance-245797532 tempest-TestShelveInstance-245797532-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1867552409" status: 202 len: 0 microversion: 2.1 time: 0.091013 May 26 15:06:07.738823 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 579/1127] 10.222.0.81 () {58 vars in 1254 bytes} [Wed May 26 15:06:07 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1867552409 => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 15:07:36.348774 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 15:07:36.349451 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: Wed May 26 15:07:36 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 15:08:03.206265 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: ERROR oslo.messaging._drivers.impl_rabbit [-] [dded7dfb-48a0-42b4-8c92-27c260f94da4] AMQP server on 10.222.0.81:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 26 15:08:03.379022 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-6f4a70d5-52eb-4ec4-8b18-9fc22a3c498f tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Action: 'create', calling method: .version_select at 0x7f441d821820>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-143429190"}} {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:08:03.403281 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.quota [None req-6f4a70d5-52eb-4ec4-8b18-9fc22a3c498f tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Getting quotas for project 511d07599f124852b029e4bc01cbdd7f. Resources: {'key_pairs'} {{(pid=118514) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 26 15:08:03.407117 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.quota [None req-6f4a70d5-52eb-4ec4-8b18-9fc22a3c498f tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Getting quotas for user 63852ad0e1224005bd20673b430b8a3d and project 511d07599f124852b029e4bc01cbdd7f. Resources: {'key_pairs'} {{(pid=118514) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 26 15:08:03.690239 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.quota [None req-6f4a70d5-52eb-4ec4-8b18-9fc22a3c498f tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Getting quotas for project 511d07599f124852b029e4bc01cbdd7f. Resources: {'key_pairs'} {{(pid=118514) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 26 15:08:03.693959 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.quota [None req-6f4a70d5-52eb-4ec4-8b18-9fc22a3c498f tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Getting quotas for user 63852ad0e1224005bd20673b430b8a3d and project 511d07599f124852b029e4bc01cbdd7f. Resources: {'key_pairs'} {{(pid=118514) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 26 15:08:03.706714 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-6f4a70d5-52eb-4ec4-8b18-9fc22a3c498f tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "POST /compute/v2.1/os-keypairs" status: 200 len: 2318 microversion: 2.1 time: 0.502010 May 26 15:08:03.707315 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 549/1128] 10.222.0.81 () {60 vars in 1158 bytes} [Wed May 26 15:08:03 2021] POST /compute/v2.1/os-keypairs => generated 2318 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:08:07.777757 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 15:08:07.778951 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: Wed May 26 15:08:07 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 15:08:23.903005 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-c3912ed7-bc47-4b60-b726-d6413ebb6385 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1860513319", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-143429190", "security_groups": [{"name": "tempest-secgroup-smoke-675203712"}], "block_device_mapping_v2": [{"uuid": "4d919ad8-1908-4e44-9349-8511208cb0cd", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "8cb13f82-5501-498d-8d6a-19501eaaa488"}]}} {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:08:23.915904 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ff6f2ecd-1b47-49c8-9039-c025e0c4e3e6] AMQP server on 10.222.0.81:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 26 15:08:24.174027 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.network.neutron [None req-c3912ed7-bc47-4b60-b726-d6413ebb6385 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] validate_networks() for [('8cb13f82-5501-498d-8d6a-19501eaaa488', None, None, None)] {{(pid=118513) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} May 26 15:08:24.878047 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.virt.hardware [None req-c3912ed7-bc47-4b60-b726-d6413ebb6385 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Flavor limits 0:0:0 {{(pid=118513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} May 26 15:08:24.878485 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.virt.hardware [None req-c3912ed7-bc47-4b60-b726-d6413ebb6385 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Image limits 0:0:0 {{(pid=118513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} May 26 15:08:24.878974 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.virt.hardware [None req-c3912ed7-bc47-4b60-b726-d6413ebb6385 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Flavor pref 0:0:0 {{(pid=118513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} May 26 15:08:24.879427 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.virt.hardware [None req-c3912ed7-bc47-4b60-b726-d6413ebb6385 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Image pref 0:0:0 {{(pid=118513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} May 26 15:08:24.879856 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.virt.hardware [None req-c3912ed7-bc47-4b60-b726-d6413ebb6385 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} May 26 15:08:24.888153 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-c3912ed7-bc47-4b60-b726-d6413ebb6385 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:08:24.888613 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-c3912ed7-bc47-4b60-b726-d6413ebb6385 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:08:24.889433 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-c3912ed7-bc47-4b60-b726-d6413ebb6385 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:08:24.889913 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-c3912ed7-bc47-4b60-b726-d6413ebb6385 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:08:24.907979 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.quota [None req-c3912ed7-bc47-4b60-b726-d6413ebb6385 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Getting quotas for project 511d07599f124852b029e4bc01cbdd7f. Resources: {'instances', 'ram', 'cores'} {{(pid=118513) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 26 15:08:24.911985 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.quota [None req-c3912ed7-bc47-4b60-b726-d6413ebb6385 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Getting quotas for user 63852ad0e1224005bd20673b430b8a3d and project 511d07599f124852b029e4bc01cbdd7f. Resources: {'instances', 'ram', 'cores'} {{(pid=118513) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 26 15:08:24.941716 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO oslo.messaging._drivers.impl_rabbit [-] [ff6f2ecd-1b47-49c8-9039-c025e0c4e3e6] Reconnected to AMQP server on 10.222.0.81:5672 via [amqp] client with port 38246. May 26 15:08:25.022910 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-c3912ed7-bc47-4b60-b726-d6413ebb6385 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Going to run 1 instances... {{(pid=118513) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 26 15:08:25.025033 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-c3912ed7-bc47-4b60-b726-d6413ebb6385 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] [instance: 7dcf546b-91d5-4718-b3f0-dee33dda4ce7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4d919ad8-1908-4e44-9349-8511208cb0cd',volume_size=None,volume_type=None)] {{(pid=118513) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} May 26 15:08:25.463308 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-c3912ed7-bc47-4b60-b726-d6413ebb6385 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.563873 May 26 15:08:25.463959 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 580/1129] 10.222.0.81 () {60 vars in 1147 bytes} [Wed May 26 15:08:23 2021] POST /compute/v2.1/servers => generated 405 bytes in 1565 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 15:08:25.484154 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-37d8d3da-21cb-4917-8e2d-87a9daf7e9ca tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:08:25.484789 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-37d8d3da-21cb-4917-8e2d-87a9daf7e9ca tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] [instance: 7dcf546b-91d5-4718-b3f0-dee33dda4ce7] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:08:25.509330 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO oslo.messaging._drivers.impl_rabbit [-] [dded7dfb-48a0-42b4-8c92-27c260f94da4] Reconnected to AMQP server on 10.222.0.81:5672 via [amqp] client with port 38256. May 26 15:08:25.723691 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-37d8d3da-21cb-4917-8e2d-87a9daf7e9ca tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63852ad0e1224005bd20673b430b8a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511d07599f124852b029e4bc01cbdd7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:08:25.735228 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-37d8d3da-21cb-4917-8e2d-87a9daf7e9ca tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "GET /compute/v2.1/servers/7dcf546b-91d5-4718-b3f0-dee33dda4ce7" status: 200 len: 1094 microversion: 2.1 time: 0.264199 May 26 15:08:25.736146 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 550/1130] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:08:25 2021] GET /compute/v2.1/servers/7dcf546b-91d5-4718-b3f0-dee33dda4ce7 => generated 1094 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:08:26.752372 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-237f1ca1-dd14-443a-aa0b-add01298c6dc tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:08:26.752956 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-237f1ca1-dd14-443a-aa0b-add01298c6dc tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] [instance: 7dcf546b-91d5-4718-b3f0-dee33dda4ce7] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:08:26.760608 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-237f1ca1-dd14-443a-aa0b-add01298c6dc tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:08:26.761162 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-237f1ca1-dd14-443a-aa0b-add01298c6dc tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:08:26.762000 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-237f1ca1-dd14-443a-aa0b-add01298c6dc tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:08:26.762446 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-237f1ca1-dd14-443a-aa0b-add01298c6dc tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:08:26.879683 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-237f1ca1-dd14-443a-aa0b-add01298c6dc tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63852ad0e1224005bd20673b430b8a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511d07599f124852b029e4bc01cbdd7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:08:26.887754 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-237f1ca1-dd14-443a-aa0b-add01298c6dc tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "GET /compute/v2.1/servers/7dcf546b-91d5-4718-b3f0-dee33dda4ce7" status: 200 len: 1144 microversion: 2.1 time: 0.139389 May 26 15:08:26.888348 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 581/1131] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:08:26 2021] GET /compute/v2.1/servers/7dcf546b-91d5-4718-b3f0-dee33dda4ce7 => generated 1144 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:08:27.905301 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-240d3e83-9ccb-4018-bcda-6650266b1da1 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:08:27.909747 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-240d3e83-9ccb-4018-bcda-6650266b1da1 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] [instance: 7dcf546b-91d5-4718-b3f0-dee33dda4ce7] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:08:27.915001 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-240d3e83-9ccb-4018-bcda-6650266b1da1 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:08:27.915450 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-240d3e83-9ccb-4018-bcda-6650266b1da1 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:08:27.916422 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-240d3e83-9ccb-4018-bcda-6650266b1da1 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:08:27.917038 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-240d3e83-9ccb-4018-bcda-6650266b1da1 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:08:28.043367 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-240d3e83-9ccb-4018-bcda-6650266b1da1 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63852ad0e1224005bd20673b430b8a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511d07599f124852b029e4bc01cbdd7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:08:28.052208 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-240d3e83-9ccb-4018-bcda-6650266b1da1 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "GET /compute/v2.1/servers/7dcf546b-91d5-4718-b3f0-dee33dda4ce7" status: 200 len: 1200 microversion: 2.1 time: 0.150749 May 26 15:08:28.052857 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 551/1132] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:08:27 2021] GET /compute/v2.1/servers/7dcf546b-91d5-4718-b3f0-dee33dda4ce7 => generated 1200 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:08:29.069353 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-7c4ea414-362a-4337-8aef-28366246911d tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:08:29.070084 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-7c4ea414-362a-4337-8aef-28366246911d tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] [instance: 7dcf546b-91d5-4718-b3f0-dee33dda4ce7] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:08:29.077893 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-7c4ea414-362a-4337-8aef-28366246911d tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:08:29.079471 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-7c4ea414-362a-4337-8aef-28366246911d tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:08:29.080369 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-7c4ea414-362a-4337-8aef-28366246911d tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:08:29.081059 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-7c4ea414-362a-4337-8aef-28366246911d tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:08:29.289837 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-7c4ea414-362a-4337-8aef-28366246911d tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63852ad0e1224005bd20673b430b8a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511d07599f124852b029e4bc01cbdd7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:08:29.300381 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-7c4ea414-362a-4337-8aef-28366246911d tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "GET /compute/v2.1/servers/7dcf546b-91d5-4718-b3f0-dee33dda4ce7" status: 200 len: 1277 microversion: 2.1 time: 0.234842 May 26 15:08:29.307844 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 582/1133] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:08:29 2021] GET /compute/v2.1/servers/7dcf546b-91d5-4718-b3f0-dee33dda4ce7 => generated 1277 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:08:30.321206 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-87747d65-ddfc-4750-bc44-40c6df50bd52 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:08:30.326638 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-87747d65-ddfc-4750-bc44-40c6df50bd52 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] [instance: 7dcf546b-91d5-4718-b3f0-dee33dda4ce7] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:08:30.329173 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-87747d65-ddfc-4750-bc44-40c6df50bd52 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:08:30.329682 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-87747d65-ddfc-4750-bc44-40c6df50bd52 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:08:30.330463 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-87747d65-ddfc-4750-bc44-40c6df50bd52 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:08:30.330903 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-87747d65-ddfc-4750-bc44-40c6df50bd52 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:08:30.528412 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [req-9919878c-07f4-4671-82e3-5a7709b1a641 req-dcb72af9-e322-4468-800a-d1b398961e47 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7dcf546b-91d5-4718-b3f0-dee33dda4ce7", "tag": "8a04a399-0467-4790-95e0-0eafe7abfa35"}]} {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:08:30.533738 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 15:08:30.533738 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: warnings.warn(msg) May 26 15:08:30.553331 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [req-9919878c-07f4-4671-82e3-5a7709b1a641 req-dcb72af9-e322-4468-800a-d1b398961e47 service nova] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:08:30.554186 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [req-9919878c-07f4-4671-82e3-5a7709b1a641 req-dcb72af9-e322-4468-800a-d1b398961e47 service nova] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:08:30.571469 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.compute.server_external_events [req-9919878c-07f4-4671-82e3-5a7709b1a641 req-dcb72af9-e322-4468-800a-d1b398961e47 service nova] Creating event network-changed:8a04a399-0467-4790-95e0-0eafe7abfa35 for instance 7dcf546b-91d5-4718-b3f0-dee33dda4ce7 on hv-cinder-78414 May 26 15:08:30.576496 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [req-9919878c-07f4-4671-82e3-5a7709b1a641 req-dcb72af9-e322-4468-800a-d1b398961e47 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051636 May 26 15:08:30.578917 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 583/1134] 10.222.0.81 () {64 vars in 1318 bytes} [Wed May 26 15:08:30 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:08:30.724706 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-87747d65-ddfc-4750-bc44-40c6df50bd52 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63852ad0e1224005bd20673b430b8a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511d07599f124852b029e4bc01cbdd7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:08:30.732987 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-87747d65-ddfc-4750-bc44-40c6df50bd52 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "GET /compute/v2.1/servers/7dcf546b-91d5-4718-b3f0-dee33dda4ce7" status: 200 len: 1265 microversion: 2.1 time: 0.415446 May 26 15:08:30.733575 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 552/1135] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:08:30 2021] GET /compute/v2.1/servers/7dcf546b-91d5-4718-b3f0-dee33dda4ce7 => generated 1265 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:08:31.751856 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-6397ac94-1dc4-4a1e-9d64-09e3f5e08aa9 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:08:31.752533 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-6397ac94-1dc4-4a1e-9d64-09e3f5e08aa9 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] [instance: 7dcf546b-91d5-4718-b3f0-dee33dda4ce7] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:08:31.760087 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-6397ac94-1dc4-4a1e-9d64-09e3f5e08aa9 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:08:31.769265 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-6397ac94-1dc4-4a1e-9d64-09e3f5e08aa9 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:08:31.769265 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-6397ac94-1dc4-4a1e-9d64-09e3f5e08aa9 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:08:31.769265 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-6397ac94-1dc4-4a1e-9d64-09e3f5e08aa9 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:08:31.958258 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-6397ac94-1dc4-4a1e-9d64-09e3f5e08aa9 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63852ad0e1224005bd20673b430b8a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511d07599f124852b029e4bc01cbdd7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:08:31.966639 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-6397ac94-1dc4-4a1e-9d64-09e3f5e08aa9 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "GET /compute/v2.1/servers/7dcf546b-91d5-4718-b3f0-dee33dda4ce7" status: 200 len: 1265 microversion: 2.1 time: 0.219659 May 26 15:08:31.967206 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 584/1136] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:08:31 2021] GET /compute/v2.1/servers/7dcf546b-91d5-4718-b3f0-dee33dda4ce7 => generated 1265 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:08:32.983933 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-4d62ee3d-c0ec-473f-8d10-83750c31a7fc tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:08:32.984542 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-4d62ee3d-c0ec-473f-8d10-83750c31a7fc tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] [instance: 7dcf546b-91d5-4718-b3f0-dee33dda4ce7] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:08:32.991817 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-4d62ee3d-c0ec-473f-8d10-83750c31a7fc tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:08:32.992277 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-4d62ee3d-c0ec-473f-8d10-83750c31a7fc tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:08:32.993060 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-4d62ee3d-c0ec-473f-8d10-83750c31a7fc tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:08:32.993507 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-4d62ee3d-c0ec-473f-8d10-83750c31a7fc tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:08:33.193881 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-4d62ee3d-c0ec-473f-8d10-83750c31a7fc tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63852ad0e1224005bd20673b430b8a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511d07599f124852b029e4bc01cbdd7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:08:33.202050 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-4d62ee3d-c0ec-473f-8d10-83750c31a7fc tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "GET /compute/v2.1/servers/7dcf546b-91d5-4718-b3f0-dee33dda4ce7" status: 200 len: 1265 microversion: 2.1 time: 0.221843 May 26 15:08:33.202629 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 553/1137] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:08:32 2021] GET /compute/v2.1/servers/7dcf546b-91d5-4718-b3f0-dee33dda4ce7 => generated 1265 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:08:34.219271 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-97b20a11-b30e-4048-81b5-2195ebc76eee tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:08:34.220022 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-97b20a11-b30e-4048-81b5-2195ebc76eee tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] [instance: 7dcf546b-91d5-4718-b3f0-dee33dda4ce7] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:08:34.227813 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-97b20a11-b30e-4048-81b5-2195ebc76eee tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:08:34.228271 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-97b20a11-b30e-4048-81b5-2195ebc76eee tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:08:34.229051 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-97b20a11-b30e-4048-81b5-2195ebc76eee tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:08:34.229497 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-97b20a11-b30e-4048-81b5-2195ebc76eee tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:08:34.426424 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-97b20a11-b30e-4048-81b5-2195ebc76eee tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63852ad0e1224005bd20673b430b8a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511d07599f124852b029e4bc01cbdd7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:08:34.434492 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-97b20a11-b30e-4048-81b5-2195ebc76eee tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "GET /compute/v2.1/servers/7dcf546b-91d5-4718-b3f0-dee33dda4ce7" status: 200 len: 1265 microversion: 2.1 time: 0.218913 May 26 15:08:34.435070 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 585/1138] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:08:34 2021] GET /compute/v2.1/servers/7dcf546b-91d5-4718-b3f0-dee33dda4ce7 => generated 1265 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:08:35.451951 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-ed7329e1-aa4f-45ec-b47b-d0d9336b31fb tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:08:35.452568 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-ed7329e1-aa4f-45ec-b47b-d0d9336b31fb tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] [instance: 7dcf546b-91d5-4718-b3f0-dee33dda4ce7] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:08:35.460910 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-ed7329e1-aa4f-45ec-b47b-d0d9336b31fb tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:08:35.461366 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-ed7329e1-aa4f-45ec-b47b-d0d9336b31fb tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:08:35.462277 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-ed7329e1-aa4f-45ec-b47b-d0d9336b31fb tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:08:35.462714 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-ed7329e1-aa4f-45ec-b47b-d0d9336b31fb tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:08:35.660370 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-ed7329e1-aa4f-45ec-b47b-d0d9336b31fb tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63852ad0e1224005bd20673b430b8a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511d07599f124852b029e4bc01cbdd7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:08:35.668558 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-ed7329e1-aa4f-45ec-b47b-d0d9336b31fb tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "GET /compute/v2.1/servers/7dcf546b-91d5-4718-b3f0-dee33dda4ce7" status: 200 len: 1265 microversion: 2.1 time: 0.220335 May 26 15:08:35.669148 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 554/1139] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:08:35 2021] GET /compute/v2.1/servers/7dcf546b-91d5-4718-b3f0-dee33dda4ce7 => generated 1265 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:08:36.685352 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-c09d393c-efe0-43c0-ac2d-0c78d754b60e tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:08:36.685995 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-c09d393c-efe0-43c0-ac2d-0c78d754b60e tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] [instance: 7dcf546b-91d5-4718-b3f0-dee33dda4ce7] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:08:36.693822 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-c09d393c-efe0-43c0-ac2d-0c78d754b60e tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:08:36.694281 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-c09d393c-efe0-43c0-ac2d-0c78d754b60e tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:08:36.695057 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-c09d393c-efe0-43c0-ac2d-0c78d754b60e tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:08:36.695503 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-c09d393c-efe0-43c0-ac2d-0c78d754b60e tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:08:36.886752 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-c09d393c-efe0-43c0-ac2d-0c78d754b60e tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63852ad0e1224005bd20673b430b8a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511d07599f124852b029e4bc01cbdd7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:08:36.894953 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-c09d393c-efe0-43c0-ac2d-0c78d754b60e tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "GET /compute/v2.1/servers/7dcf546b-91d5-4718-b3f0-dee33dda4ce7" status: 200 len: 1265 microversion: 2.1 time: 0.213305 May 26 15:08:36.895785 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 586/1140] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:08:36 2021] GET /compute/v2.1/servers/7dcf546b-91d5-4718-b3f0-dee33dda4ce7 => generated 1265 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:08:37.912201 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-2518c4bb-5630-4503-b42b-7641afed53a2 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:08:37.912826 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-2518c4bb-5630-4503-b42b-7641afed53a2 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] [instance: 7dcf546b-91d5-4718-b3f0-dee33dda4ce7] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:08:37.920149 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-2518c4bb-5630-4503-b42b-7641afed53a2 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:08:37.920604 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-2518c4bb-5630-4503-b42b-7641afed53a2 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:08:37.921391 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-2518c4bb-5630-4503-b42b-7641afed53a2 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:08:37.921859 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-2518c4bb-5630-4503-b42b-7641afed53a2 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:08:38.128372 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-2518c4bb-5630-4503-b42b-7641afed53a2 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63852ad0e1224005bd20673b430b8a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511d07599f124852b029e4bc01cbdd7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:08:38.136563 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-2518c4bb-5630-4503-b42b-7641afed53a2 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "GET /compute/v2.1/servers/7dcf546b-91d5-4718-b3f0-dee33dda4ce7" status: 200 len: 1265 microversion: 2.1 time: 0.228104 May 26 15:08:38.137128 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 555/1141] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:08:37 2021] GET /compute/v2.1/servers/7dcf546b-91d5-4718-b3f0-dee33dda4ce7 => generated 1265 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:08:39.153527 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-fcbbf859-3e39-4bd4-93ba-cc886caae14e tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:08:39.154188 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-fcbbf859-3e39-4bd4-93ba-cc886caae14e tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] [instance: 7dcf546b-91d5-4718-b3f0-dee33dda4ce7] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:08:39.161776 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-fcbbf859-3e39-4bd4-93ba-cc886caae14e tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:08:39.162239 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-fcbbf859-3e39-4bd4-93ba-cc886caae14e tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:08:39.163024 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-fcbbf859-3e39-4bd4-93ba-cc886caae14e tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:08:39.163472 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-fcbbf859-3e39-4bd4-93ba-cc886caae14e tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:08:39.365255 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-fcbbf859-3e39-4bd4-93ba-cc886caae14e tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63852ad0e1224005bd20673b430b8a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511d07599f124852b029e4bc01cbdd7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:08:39.373763 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-fcbbf859-3e39-4bd4-93ba-cc886caae14e tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "GET /compute/v2.1/servers/7dcf546b-91d5-4718-b3f0-dee33dda4ce7" status: 200 len: 1265 microversion: 2.1 time: 0.223982 May 26 15:08:39.374344 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 587/1142] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:08:39 2021] GET /compute/v2.1/servers/7dcf546b-91d5-4718-b3f0-dee33dda4ce7 => generated 1265 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:08:40.390258 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-79aa86ee-ec2f-4bb8-a5c9-4bed114127a4 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:08:40.390881 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-79aa86ee-ec2f-4bb8-a5c9-4bed114127a4 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] [instance: 7dcf546b-91d5-4718-b3f0-dee33dda4ce7] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:08:40.398600 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-79aa86ee-ec2f-4bb8-a5c9-4bed114127a4 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:08:40.399061 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-79aa86ee-ec2f-4bb8-a5c9-4bed114127a4 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:08:40.399840 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-79aa86ee-ec2f-4bb8-a5c9-4bed114127a4 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:08:40.400293 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-79aa86ee-ec2f-4bb8-a5c9-4bed114127a4 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:08:40.597058 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-79aa86ee-ec2f-4bb8-a5c9-4bed114127a4 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63852ad0e1224005bd20673b430b8a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511d07599f124852b029e4bc01cbdd7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:08:40.605430 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-79aa86ee-ec2f-4bb8-a5c9-4bed114127a4 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "GET /compute/v2.1/servers/7dcf546b-91d5-4718-b3f0-dee33dda4ce7" status: 200 len: 1265 microversion: 2.1 time: 0.218894 May 26 15:08:40.606028 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 556/1143] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:08:40 2021] GET /compute/v2.1/servers/7dcf546b-91d5-4718-b3f0-dee33dda4ce7 => generated 1265 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:08:41.374524 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [req-fc27a663-1780-4dc0-aade-4fe476aec33f req-c019e799-d5d5-45ff-a3af-9668ed1e59c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7dcf546b-91d5-4718-b3f0-dee33dda4ce7", "name": "network-vif-plugged", "status": "completed", "tag": "8a04a399-0467-4790-95e0-0eafe7abfa35"}]} {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:08:41.376056 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 15:08:41.376056 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: warnings.warn(msg) May 26 15:08:41.385496 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [req-fc27a663-1780-4dc0-aade-4fe476aec33f req-c019e799-d5d5-45ff-a3af-9668ed1e59c2 service nova] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:08:41.385970 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [req-fc27a663-1780-4dc0-aade-4fe476aec33f req-c019e799-d5d5-45ff-a3af-9668ed1e59c2 service nova] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:08:41.402294 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.compute.server_external_events [req-fc27a663-1780-4dc0-aade-4fe476aec33f req-c019e799-d5d5-45ff-a3af-9668ed1e59c2 service nova] Creating event network-vif-plugged:8a04a399-0467-4790-95e0-0eafe7abfa35 for instance 7dcf546b-91d5-4718-b3f0-dee33dda4ce7 on hv-cinder-78414 May 26 15:08:41.407199 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [req-fc27a663-1780-4dc0-aade-4fe476aec33f req-c019e799-d5d5-45ff-a3af-9668ed1e59c2 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091773 May 26 15:08:41.407795 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 588/1144] 10.222.0.81 () {64 vars in 1318 bytes} [Wed May 26 15:08:41 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:08:41.621914 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-59c1a18d-9fab-48d6-aef1-19b45a799c5f tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:08:41.622530 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-59c1a18d-9fab-48d6-aef1-19b45a799c5f tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] [instance: 7dcf546b-91d5-4718-b3f0-dee33dda4ce7] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:08:41.629861 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-59c1a18d-9fab-48d6-aef1-19b45a799c5f tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:08:41.630318 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-59c1a18d-9fab-48d6-aef1-19b45a799c5f tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:08:41.631095 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-59c1a18d-9fab-48d6-aef1-19b45a799c5f tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:08:41.631542 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-59c1a18d-9fab-48d6-aef1-19b45a799c5f tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:08:41.917420 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-59c1a18d-9fab-48d6-aef1-19b45a799c5f tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63852ad0e1224005bd20673b430b8a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511d07599f124852b029e4bc01cbdd7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:08:41.925500 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-59c1a18d-9fab-48d6-aef1-19b45a799c5f tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "GET /compute/v2.1/servers/7dcf546b-91d5-4718-b3f0-dee33dda4ce7" status: 200 len: 1265 microversion: 2.1 time: 0.307410 May 26 15:08:41.926086 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 557/1145] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:08:41 2021] GET /compute/v2.1/servers/7dcf546b-91d5-4718-b3f0-dee33dda4ce7 => generated 1265 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:08:42.943162 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-6fd38698-972d-4903-929a-5aff20b403a5 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:08:42.943862 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-6fd38698-972d-4903-929a-5aff20b403a5 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] [instance: 7dcf546b-91d5-4718-b3f0-dee33dda4ce7] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:08:42.951253 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-6fd38698-972d-4903-929a-5aff20b403a5 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:08:42.951715 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-6fd38698-972d-4903-929a-5aff20b403a5 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:08:42.952487 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-6fd38698-972d-4903-929a-5aff20b403a5 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:08:42.952927 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-6fd38698-972d-4903-929a-5aff20b403a5 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:08:43.153350 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-6fd38698-972d-4903-929a-5aff20b403a5 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63852ad0e1224005bd20673b430b8a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511d07599f124852b029e4bc01cbdd7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:08:43.162541 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-6fd38698-972d-4903-929a-5aff20b403a5 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "GET /compute/v2.1/servers/7dcf546b-91d5-4718-b3f0-dee33dda4ce7" status: 200 len: 1452 microversion: 2.1 time: 0.223662 May 26 15:08:43.163115 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 589/1146] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:08:42 2021] GET /compute/v2.1/servers/7dcf546b-91d5-4718-b3f0-dee33dda4ce7 => generated 1452 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:08:43.178350 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-b9c8463e-9a7d-4ccf-9b3c-f08efbb084bd tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:08:43.178992 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-b9c8463e-9a7d-4ccf-9b3c-f08efbb084bd tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] [instance: 7dcf546b-91d5-4718-b3f0-dee33dda4ce7] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:08:43.186215 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-b9c8463e-9a7d-4ccf-9b3c-f08efbb084bd tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:08:43.186683 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-b9c8463e-9a7d-4ccf-9b3c-f08efbb084bd tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:08:43.187463 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-b9c8463e-9a7d-4ccf-9b3c-f08efbb084bd tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:08:43.187908 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-b9c8463e-9a7d-4ccf-9b3c-f08efbb084bd tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:08:43.381138 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-b9c8463e-9a7d-4ccf-9b3c-f08efbb084bd tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63852ad0e1224005bd20673b430b8a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511d07599f124852b029e4bc01cbdd7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:08:43.389423 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-b9c8463e-9a7d-4ccf-9b3c-f08efbb084bd tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "GET /compute/v2.1/servers/7dcf546b-91d5-4718-b3f0-dee33dda4ce7" status: 200 len: 1452 microversion: 2.1 time: 0.214800 May 26 15:08:43.390023 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 558/1147] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:08:43 2021] GET /compute/v2.1/servers/7dcf546b-91d5-4718-b3f0-dee33dda4ce7 => generated 1452 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:08:46.441446 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [req-93d7cb1f-8e7e-4f7a-b82b-4d85ae043879 req-275f919a-ce4a-47fe-8f45-8a7748be96bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7dcf546b-91d5-4718-b3f0-dee33dda4ce7", "tag": "8a04a399-0467-4790-95e0-0eafe7abfa35"}]} {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:08:46.443126 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 15:08:46.443126 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: warnings.warn(msg) May 26 15:08:46.451415 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [req-93d7cb1f-8e7e-4f7a-b82b-4d85ae043879 req-275f919a-ce4a-47fe-8f45-8a7748be96bb service nova] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:08:46.451965 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [req-93d7cb1f-8e7e-4f7a-b82b-4d85ae043879 req-275f919a-ce4a-47fe-8f45-8a7748be96bb service nova] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:08:46.467990 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.compute.server_external_events [req-93d7cb1f-8e7e-4f7a-b82b-4d85ae043879 req-275f919a-ce4a-47fe-8f45-8a7748be96bb service nova] Creating event network-changed:8a04a399-0467-4790-95e0-0eafe7abfa35 for instance 7dcf546b-91d5-4718-b3f0-dee33dda4ce7 on hv-cinder-78414 May 26 15:08:46.473454 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [req-93d7cb1f-8e7e-4f7a-b82b-4d85ae043879 req-275f919a-ce4a-47fe-8f45-8a7748be96bb service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086660 May 26 15:08:46.474090 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 590/1148] 10.222.0.81 () {64 vars in 1318 bytes} [Wed May 26 15:08:46 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:09:39.825103 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 15:09:39.825641 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: Wed May 26 15:09:39 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 15:10:18.475327 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 15:10:18.476031 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: Wed May 26 15:10:18 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 15:10:41.116239 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-7c9f6196-d9a8-4fc7-a052-ac347aed40e3 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:41.116897 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-7c9f6196-d9a8-4fc7-a052-ac347aed40e3 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] [instance: 7dcf546b-91d5-4718-b3f0-dee33dda4ce7] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:10:41.124818 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-7c9f6196-d9a8-4fc7-a052-ac347aed40e3 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:10:41.125277 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-7c9f6196-d9a8-4fc7-a052-ac347aed40e3 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:10:41.126087 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-7c9f6196-d9a8-4fc7-a052-ac347aed40e3 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:10:41.126536 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-7c9f6196-d9a8-4fc7-a052-ac347aed40e3 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:10:41.188739 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-7c9f6196-d9a8-4fc7-a052-ac347aed40e3 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] [instance: 7dcf546b-91d5-4718-b3f0-dee33dda4ce7] Going to try to terminate instance {{(pid=118514) delete /opt/stack/nova/nova/compute/api.py:2539}} May 26 15:10:41.492780 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-7c9f6196-d9a8-4fc7-a052-ac347aed40e3 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "DELETE /compute/v2.1/servers/7dcf546b-91d5-4718-b3f0-dee33dda4ce7" status: 204 len: 0 microversion: 2.1 time: 0.380137 May 26 15:10:41.493444 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 559/1149] 10.222.0.81 () {58 vars in 1239 bytes} [Wed May 26 15:10:41 2021] DELETE /compute/v2.1/servers/7dcf546b-91d5-4718-b3f0-dee33dda4ce7 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 15:10:41.505219 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ff6f2ecd-1b47-49c8-9039-c025e0c4e3e6] AMQP server on 10.222.0.81:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed May 26 15:10:41.509021 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-b2279346-bb26-4a6c-a2a7-d632bb1943b8 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:41.509756 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-b2279346-bb26-4a6c-a2a7-d632bb1943b8 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] [instance: 7dcf546b-91d5-4718-b3f0-dee33dda4ce7] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:10:41.517988 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-b2279346-bb26-4a6c-a2a7-d632bb1943b8 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:10:41.518746 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-b2279346-bb26-4a6c-a2a7-d632bb1943b8 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:10:41.519497 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-b2279346-bb26-4a6c-a2a7-d632bb1943b8 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:10:41.519942 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-b2279346-bb26-4a6c-a2a7-d632bb1943b8 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:10:41.717872 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-b2279346-bb26-4a6c-a2a7-d632bb1943b8 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63852ad0e1224005bd20673b430b8a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511d07599f124852b029e4bc01cbdd7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:41.725988 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-b2279346-bb26-4a6c-a2a7-d632bb1943b8 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "GET /compute/v2.1/servers/7dcf546b-91d5-4718-b3f0-dee33dda4ce7" status: 200 len: 1577 microversion: 2.1 time: 0.222460 May 26 15:10:41.726558 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 591/1150] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:10:41 2021] GET /compute/v2.1/servers/7dcf546b-91d5-4718-b3f0-dee33dda4ce7 => generated 1577 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:10:42.744346 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-95d6c75a-7cfb-4b89-98b6-3a0c2b3e0df9 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:42.745049 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-95d6c75a-7cfb-4b89-98b6-3a0c2b3e0df9 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] [instance: 7dcf546b-91d5-4718-b3f0-dee33dda4ce7] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:10:42.752979 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-95d6c75a-7cfb-4b89-98b6-3a0c2b3e0df9 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:10:42.753432 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-95d6c75a-7cfb-4b89-98b6-3a0c2b3e0df9 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:10:42.754240 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-95d6c75a-7cfb-4b89-98b6-3a0c2b3e0df9 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:10:42.754680 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-95d6c75a-7cfb-4b89-98b6-3a0c2b3e0df9 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:10:42.947505 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-95d6c75a-7cfb-4b89-98b6-3a0c2b3e0df9 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63852ad0e1224005bd20673b430b8a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511d07599f124852b029e4bc01cbdd7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:42.956241 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-95d6c75a-7cfb-4b89-98b6-3a0c2b3e0df9 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "GET /compute/v2.1/servers/7dcf546b-91d5-4718-b3f0-dee33dda4ce7" status: 200 len: 1577 microversion: 2.1 time: 0.216056 May 26 15:10:42.956998 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 560/1151] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:10:42 2021] GET /compute/v2.1/servers/7dcf546b-91d5-4718-b3f0-dee33dda4ce7 => generated 1577 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:10:43.976284 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-bdfc5e18-0fa1-411b-aa47-3e916e04dd7c tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:43.977654 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-bdfc5e18-0fa1-411b-aa47-3e916e04dd7c tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] [instance: 7dcf546b-91d5-4718-b3f0-dee33dda4ce7] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:10:44.003819 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO oslo.messaging._drivers.impl_rabbit [-] [ff6f2ecd-1b47-49c8-9039-c025e0c4e3e6] Reconnected to AMQP server on 10.222.0.81:5672 via [amqp] client with port 38370. May 26 15:10:44.006251 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-bdfc5e18-0fa1-411b-aa47-3e916e04dd7c tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:10:44.006717 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-bdfc5e18-0fa1-411b-aa47-3e916e04dd7c tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:10:44.007526 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-bdfc5e18-0fa1-411b-aa47-3e916e04dd7c tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:10:44.007967 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-bdfc5e18-0fa1-411b-aa47-3e916e04dd7c tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:10:44.138570 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-bdfc5e18-0fa1-411b-aa47-3e916e04dd7c tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63852ad0e1224005bd20673b430b8a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511d07599f124852b029e4bc01cbdd7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:44.148378 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-bdfc5e18-0fa1-411b-aa47-3e916e04dd7c tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "GET /compute/v2.1/servers/7dcf546b-91d5-4718-b3f0-dee33dda4ce7" status: 200 len: 1510 microversion: 2.1 time: 0.178203 May 26 15:10:44.148949 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 592/1152] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:10:43 2021] GET /compute/v2.1/servers/7dcf546b-91d5-4718-b3f0-dee33dda4ce7 => generated 1510 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:10:44.518737 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [req-9e90170e-2b58-4d87-9c07-c36854e81cd3 req-e57d137a-1947-4241-b523-485a866f05de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7dcf546b-91d5-4718-b3f0-dee33dda4ce7", "name": "network-vif-deleted", "tag": "8a04a399-0467-4790-95e0-0eafe7abfa35"}]} {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:10:44.520605 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 15:10:44.520605 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: warnings.warn(msg) May 26 15:10:44.529234 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [req-9e90170e-2b58-4d87-9c07-c36854e81cd3 req-e57d137a-1947-4241-b523-485a866f05de service nova] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:10:44.529714 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [req-9e90170e-2b58-4d87-9c07-c36854e81cd3 req-e57d137a-1947-4241-b523-485a866f05de service nova] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:10:44.549390 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.compute.server_external_events [req-9e90170e-2b58-4d87-9c07-c36854e81cd3 req-e57d137a-1947-4241-b523-485a866f05de service nova] Creating event network-vif-deleted:8a04a399-0467-4790-95e0-0eafe7abfa35 for instance 7dcf546b-91d5-4718-b3f0-dee33dda4ce7 on hv-cinder-78414 May 26 15:10:44.554975 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [req-9e90170e-2b58-4d87-9c07-c36854e81cd3 req-e57d137a-1947-4241-b523-485a866f05de service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039915 May 26 15:10:44.555864 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 561/1153] 10.222.0.81 () {64 vars in 1318 bytes} [Wed May 26 15:10:44 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 15:10:45.165804 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-743c4857-4333-454d-97e6-e8642001ed6d tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:45.166541 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-743c4857-4333-454d-97e6-e8642001ed6d tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] [instance: 7dcf546b-91d5-4718-b3f0-dee33dda4ce7] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:10:45.174764 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-743c4857-4333-454d-97e6-e8642001ed6d tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:10:45.175229 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-743c4857-4333-454d-97e6-e8642001ed6d tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:10:45.176065 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-743c4857-4333-454d-97e6-e8642001ed6d tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:10:45.176681 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-743c4857-4333-454d-97e6-e8642001ed6d tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:10:45.248336 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-743c4857-4333-454d-97e6-e8642001ed6d tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:10:45.248799 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-743c4857-4333-454d-97e6-e8642001ed6d tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:10:45.249258 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.objects.instance [None req-743c4857-4333-454d-97e6-e8642001ed6d tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lazy-loading 'fault' on Instance uuid 7dcf546b-91d5-4718-b3f0-dee33dda4ce7 {{(pid=118513) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} May 26 15:10:45.312966 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-743c4857-4333-454d-97e6-e8642001ed6d tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63852ad0e1224005bd20673b430b8a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511d07599f124852b029e4bc01cbdd7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:45.321246 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-743c4857-4333-454d-97e6-e8642001ed6d tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "GET /compute/v2.1/servers/7dcf546b-91d5-4718-b3f0-dee33dda4ce7" status: 200 len: 1230 microversion: 2.1 time: 0.159290 May 26 15:10:45.321841 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 593/1154] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:10:45 2021] GET /compute/v2.1/servers/7dcf546b-91d5-4718-b3f0-dee33dda4ce7 => generated 1230 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:10:46.339442 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-0bdc51c1-0116-48ab-b1a1-e153310c338b tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:46.340154 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-0bdc51c1-0116-48ab-b1a1-e153310c338b tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] [instance: 7dcf546b-91d5-4718-b3f0-dee33dda4ce7] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:10:46.347558 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-0bdc51c1-0116-48ab-b1a1-e153310c338b tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:10:46.348013 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-0bdc51c1-0116-48ab-b1a1-e153310c338b tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:10:46.348800 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-0bdc51c1-0116-48ab-b1a1-e153310c338b tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:10:46.349246 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-0bdc51c1-0116-48ab-b1a1-e153310c338b tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:10:46.398306 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.wsgi [None req-0bdc51c1-0116-48ab-b1a1-e153310c338b tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] HTTP exception thrown: Instance 7dcf546b-91d5-4718-b3f0-dee33dda4ce7 could not be found. May 26 15:10:46.398917 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-0bdc51c1-0116-48ab-b1a1-e153310c338b tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Returning 404 to user: Instance 7dcf546b-91d5-4718-b3f0-dee33dda4ce7 could not be found. {{(pid=118514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 26 15:10:46.399762 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-0bdc51c1-0116-48ab-b1a1-e153310c338b tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "GET /compute/v2.1/servers/7dcf546b-91d5-4718-b3f0-dee33dda4ce7" status: 404 len: 111 microversion: 2.1 time: 0.065288 May 26 15:10:46.400323 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 562/1155] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:10:46 2021] GET /compute/v2.1/servers/7dcf546b-91d5-4718-b3f0-dee33dda4ce7 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 15:10:46.484873 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-b1a088ce-9c3a-44ba-b87b-fc10b9dda7d3 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1905313586", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-143429190", "security_groups": [{"name": "tempest-secgroup-smoke-675203712"}], "block_device_mapping_v2": [{"uuid": "4d919ad8-1908-4e44-9349-8511208cb0cd", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "8cb13f82-5501-498d-8d6a-19501eaaa488"}]}} {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:10:46.641451 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.network.neutron [None req-b1a088ce-9c3a-44ba-b87b-fc10b9dda7d3 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] validate_networks() for [('8cb13f82-5501-498d-8d6a-19501eaaa488', None, None, None)] {{(pid=118513) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} May 26 15:10:47.157834 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.virt.hardware [None req-b1a088ce-9c3a-44ba-b87b-fc10b9dda7d3 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Flavor limits 0:0:0 {{(pid=118513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} May 26 15:10:47.158271 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.virt.hardware [None req-b1a088ce-9c3a-44ba-b87b-fc10b9dda7d3 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Image limits 0:0:0 {{(pid=118513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} May 26 15:10:47.158757 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.virt.hardware [None req-b1a088ce-9c3a-44ba-b87b-fc10b9dda7d3 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Flavor pref 0:0:0 {{(pid=118513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} May 26 15:10:47.159204 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.virt.hardware [None req-b1a088ce-9c3a-44ba-b87b-fc10b9dda7d3 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Image pref 0:0:0 {{(pid=118513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} May 26 15:10:47.159626 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.virt.hardware [None req-b1a088ce-9c3a-44ba-b87b-fc10b9dda7d3 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} May 26 15:10:47.168110 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-b1a088ce-9c3a-44ba-b87b-fc10b9dda7d3 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:10:47.168568 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-b1a088ce-9c3a-44ba-b87b-fc10b9dda7d3 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:10:47.169385 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-b1a088ce-9c3a-44ba-b87b-fc10b9dda7d3 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:10:47.169871 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-b1a088ce-9c3a-44ba-b87b-fc10b9dda7d3 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:10:47.187264 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.quota [None req-b1a088ce-9c3a-44ba-b87b-fc10b9dda7d3 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Getting quotas for project 511d07599f124852b029e4bc01cbdd7f. Resources: {'instances', 'ram', 'cores'} {{(pid=118513) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 26 15:10:47.191233 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.quota [None req-b1a088ce-9c3a-44ba-b87b-fc10b9dda7d3 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Getting quotas for user 63852ad0e1224005bd20673b430b8a3d and project 511d07599f124852b029e4bc01cbdd7f. Resources: {'instances', 'ram', 'cores'} {{(pid=118513) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 26 15:10:47.289308 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-b1a088ce-9c3a-44ba-b87b-fc10b9dda7d3 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Going to run 1 instances... {{(pid=118513) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 26 15:10:47.291478 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-b1a088ce-9c3a-44ba-b87b-fc10b9dda7d3 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] [instance: fcd7d41b-b99b-4502-9ab8-7d51564e17a0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4d919ad8-1908-4e44-9349-8511208cb0cd',volume_size=None,volume_type=None)] {{(pid=118513) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} May 26 15:10:47.746901 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: ERROR oslo.messaging._drivers.impl_rabbit [None req-b1a088ce-9c3a-44ba-b87b-fc10b9dda7d3 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] [ccc120c3-4c44-420b-b187-ccb644027720] AMQP server on 10.222.0.81:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 26 15:10:48.765165 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO oslo.messaging._drivers.impl_rabbit [None req-b1a088ce-9c3a-44ba-b87b-fc10b9dda7d3 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] [ccc120c3-4c44-420b-b187-ccb644027720] Reconnected to AMQP server on 10.222.0.81:5672 via [amqp] client with port 38390. May 26 15:10:48.768931 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-b1a088ce-9c3a-44ba-b87b-fc10b9dda7d3 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.287994 May 26 15:10:48.769878 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 594/1156] 10.222.0.81 () {60 vars in 1147 bytes} [Wed May 26 15:10:46 2021] POST /compute/v2.1/servers => generated 405 bytes in 2290 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 15:10:48.779508 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-a86fe4d2-d018-4588-9d7d-119ac49f498b tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:48.780119 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-a86fe4d2-d018-4588-9d7d-119ac49f498b tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] [instance: fcd7d41b-b99b-4502-9ab8-7d51564e17a0] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:10:48.975496 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-a86fe4d2-d018-4588-9d7d-119ac49f498b tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63852ad0e1224005bd20673b430b8a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511d07599f124852b029e4bc01cbdd7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:48.983631 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-a86fe4d2-d018-4588-9d7d-119ac49f498b tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "GET /compute/v2.1/servers/fcd7d41b-b99b-4502-9ab8-7d51564e17a0" status: 200 len: 1094 microversion: 2.1 time: 0.207823 May 26 15:10:48.984184 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 563/1157] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:10:48 2021] GET /compute/v2.1/servers/fcd7d41b-b99b-4502-9ab8-7d51564e17a0 => generated 1094 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:10:50.000146 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-d6f37ce8-9736-471f-b98d-6436db85da0c tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:50.000771 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-d6f37ce8-9736-471f-b98d-6436db85da0c tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] [instance: fcd7d41b-b99b-4502-9ab8-7d51564e17a0] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:10:50.073816 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-d6f37ce8-9736-471f-b98d-6436db85da0c tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63852ad0e1224005bd20673b430b8a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511d07599f124852b029e4bc01cbdd7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:50.081161 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-d6f37ce8-9736-471f-b98d-6436db85da0c tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "GET /compute/v2.1/servers/fcd7d41b-b99b-4502-9ab8-7d51564e17a0" status: 200 len: 1094 microversion: 2.1 time: 0.084713 May 26 15:10:50.081751 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 595/1158] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:10:49 2021] GET /compute/v2.1/servers/fcd7d41b-b99b-4502-9ab8-7d51564e17a0 => generated 1094 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:10:51.098244 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-f0f0bb13-d98d-4762-b3d9-9f07f98d5d9c tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:51.098979 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-f0f0bb13-d98d-4762-b3d9-9f07f98d5d9c tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] [instance: fcd7d41b-b99b-4502-9ab8-7d51564e17a0] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:10:51.171773 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-f0f0bb13-d98d-4762-b3d9-9f07f98d5d9c tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63852ad0e1224005bd20673b430b8a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511d07599f124852b029e4bc01cbdd7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:51.179323 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-f0f0bb13-d98d-4762-b3d9-9f07f98d5d9c tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "GET /compute/v2.1/servers/fcd7d41b-b99b-4502-9ab8-7d51564e17a0" status: 200 len: 1094 microversion: 2.1 time: 0.084719 May 26 15:10:51.179894 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 564/1159] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:10:51 2021] GET /compute/v2.1/servers/fcd7d41b-b99b-4502-9ab8-7d51564e17a0 => generated 1094 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:10:52.195821 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-8f2f1cd9-3a67-4b44-bb0c-fb81c12890fc tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:52.196448 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-8f2f1cd9-3a67-4b44-bb0c-fb81c12890fc tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] [instance: fcd7d41b-b99b-4502-9ab8-7d51564e17a0] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:10:52.265118 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-8f2f1cd9-3a67-4b44-bb0c-fb81c12890fc tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63852ad0e1224005bd20673b430b8a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511d07599f124852b029e4bc01cbdd7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:52.272826 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-8f2f1cd9-3a67-4b44-bb0c-fb81c12890fc tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "GET /compute/v2.1/servers/fcd7d41b-b99b-4502-9ab8-7d51564e17a0" status: 200 len: 1094 microversion: 2.1 time: 0.080733 May 26 15:10:52.273385 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 596/1160] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:10:52 2021] GET /compute/v2.1/servers/fcd7d41b-b99b-4502-9ab8-7d51564e17a0 => generated 1094 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:10:53.289361 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-bdc1bb54-7d1e-4716-b32a-58ca46b02101 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:53.290001 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-bdc1bb54-7d1e-4716-b32a-58ca46b02101 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] [instance: fcd7d41b-b99b-4502-9ab8-7d51564e17a0] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:10:53.297256 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-bdc1bb54-7d1e-4716-b32a-58ca46b02101 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:10:53.297750 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-bdc1bb54-7d1e-4716-b32a-58ca46b02101 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:10:53.298523 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-bdc1bb54-7d1e-4716-b32a-58ca46b02101 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:10:53.298963 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-bdc1bb54-7d1e-4716-b32a-58ca46b02101 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:10:53.413325 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-bdc1bb54-7d1e-4716-b32a-58ca46b02101 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63852ad0e1224005bd20673b430b8a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511d07599f124852b029e4bc01cbdd7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:53.421509 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-bdc1bb54-7d1e-4716-b32a-58ca46b02101 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "GET /compute/v2.1/servers/fcd7d41b-b99b-4502-9ab8-7d51564e17a0" status: 200 len: 1144 microversion: 2.1 time: 0.135983 May 26 15:10:53.422099 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 565/1161] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:10:53 2021] GET /compute/v2.1/servers/fcd7d41b-b99b-4502-9ab8-7d51564e17a0 => generated 1144 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:10:54.437616 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-465aafe9-8dfb-4666-a4d1-a0554d487fe9 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:54.438240 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-465aafe9-8dfb-4666-a4d1-a0554d487fe9 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] [instance: fcd7d41b-b99b-4502-9ab8-7d51564e17a0] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:10:54.445618 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-465aafe9-8dfb-4666-a4d1-a0554d487fe9 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:10:54.446082 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-465aafe9-8dfb-4666-a4d1-a0554d487fe9 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:10:54.446866 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-465aafe9-8dfb-4666-a4d1-a0554d487fe9 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:10:54.447312 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-465aafe9-8dfb-4666-a4d1-a0554d487fe9 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:10:54.568223 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-465aafe9-8dfb-4666-a4d1-a0554d487fe9 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63852ad0e1224005bd20673b430b8a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511d07599f124852b029e4bc01cbdd7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:54.577009 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-465aafe9-8dfb-4666-a4d1-a0554d487fe9 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "GET /compute/v2.1/servers/fcd7d41b-b99b-4502-9ab8-7d51564e17a0" status: 200 len: 1192 microversion: 2.1 time: 0.143175 May 26 15:10:54.577593 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 597/1162] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:10:54 2021] GET /compute/v2.1/servers/fcd7d41b-b99b-4502-9ab8-7d51564e17a0 => generated 1192 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:10:55.594236 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-e03f3037-79bb-4071-91a5-fda18a7a0f7a tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:55.594908 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-e03f3037-79bb-4071-91a5-fda18a7a0f7a tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] [instance: fcd7d41b-b99b-4502-9ab8-7d51564e17a0] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:10:55.604072 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-e03f3037-79bb-4071-91a5-fda18a7a0f7a tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:10:55.608194 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-e03f3037-79bb-4071-91a5-fda18a7a0f7a tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:10:55.608194 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-e03f3037-79bb-4071-91a5-fda18a7a0f7a tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:10:55.608194 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-e03f3037-79bb-4071-91a5-fda18a7a0f7a tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:10:55.965368 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-e03f3037-79bb-4071-91a5-fda18a7a0f7a tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63852ad0e1224005bd20673b430b8a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511d07599f124852b029e4bc01cbdd7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:55.977311 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-e03f3037-79bb-4071-91a5-fda18a7a0f7a tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "GET /compute/v2.1/servers/fcd7d41b-b99b-4502-9ab8-7d51564e17a0" status: 200 len: 1277 microversion: 2.1 time: 0.387040 May 26 15:10:55.977920 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 566/1163] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:10:55 2021] GET /compute/v2.1/servers/fcd7d41b-b99b-4502-9ab8-7d51564e17a0 => generated 1277 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:10:56.994167 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-8cb766bb-1076-47c4-8187-3f4f2db3634e tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:56.994791 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-8cb766bb-1076-47c4-8187-3f4f2db3634e tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] [instance: fcd7d41b-b99b-4502-9ab8-7d51564e17a0] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:10:57.002788 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-8cb766bb-1076-47c4-8187-3f4f2db3634e tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:10:57.003247 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-8cb766bb-1076-47c4-8187-3f4f2db3634e tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:10:57.004033 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-8cb766bb-1076-47c4-8187-3f4f2db3634e tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:10:57.004480 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-8cb766bb-1076-47c4-8187-3f4f2db3634e tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:10:57.174075 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [req-9cbd367c-16a3-4aca-9b8f-4e7067c41b70 req-6987dde9-f564-41f5-887a-e536e5af3419 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fcd7d41b-b99b-4502-9ab8-7d51564e17a0", "tag": "e19df163-9d36-4b27-a614-a95afeeb27c6"}]} {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:10:57.175691 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 15:10:57.175691 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: warnings.warn(msg) May 26 15:10:57.187093 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [req-9cbd367c-16a3-4aca-9b8f-4e7067c41b70 req-6987dde9-f564-41f5-887a-e536e5af3419 service nova] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:10:57.188004 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [req-9cbd367c-16a3-4aca-9b8f-4e7067c41b70 req-6987dde9-f564-41f5-887a-e536e5af3419 service nova] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:10:57.207871 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.compute.server_external_events [req-9cbd367c-16a3-4aca-9b8f-4e7067c41b70 req-6987dde9-f564-41f5-887a-e536e5af3419 service nova] Creating event network-changed:e19df163-9d36-4b27-a614-a95afeeb27c6 for instance fcd7d41b-b99b-4502-9ab8-7d51564e17a0 on hv-cinder-78414 May 26 15:10:57.213509 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [req-9cbd367c-16a3-4aca-9b8f-4e7067c41b70 req-6987dde9-f564-41f5-887a-e536e5af3419 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043758 May 26 15:10:57.214378 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 567/1164] 10.222.0.81 () {64 vars in 1318 bytes} [Wed May 26 15:10:57 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 15:10:57.227403 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-8cb766bb-1076-47c4-8187-3f4f2db3634e tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63852ad0e1224005bd20673b430b8a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511d07599f124852b029e4bc01cbdd7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:57.239549 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-8cb766bb-1076-47c4-8187-3f4f2db3634e tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "GET /compute/v2.1/servers/fcd7d41b-b99b-4502-9ab8-7d51564e17a0" status: 200 len: 1265 microversion: 2.1 time: 0.248956 May 26 15:10:57.240710 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 598/1165] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:10:56 2021] GET /compute/v2.1/servers/fcd7d41b-b99b-4502-9ab8-7d51564e17a0 => generated 1265 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:10:58.264254 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-34707b08-a835-486b-a598-858d166ca222 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:58.265042 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-34707b08-a835-486b-a598-858d166ca222 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] [instance: fcd7d41b-b99b-4502-9ab8-7d51564e17a0] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:10:58.272814 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-34707b08-a835-486b-a598-858d166ca222 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:10:58.273266 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-34707b08-a835-486b-a598-858d166ca222 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:10:58.274061 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-34707b08-a835-486b-a598-858d166ca222 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:10:58.274502 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-34707b08-a835-486b-a598-858d166ca222 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:10:58.550227 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-34707b08-a835-486b-a598-858d166ca222 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63852ad0e1224005bd20673b430b8a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511d07599f124852b029e4bc01cbdd7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:58.559278 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-34707b08-a835-486b-a598-858d166ca222 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "GET /compute/v2.1/servers/fcd7d41b-b99b-4502-9ab8-7d51564e17a0" status: 200 len: 1265 microversion: 2.1 time: 0.299806 May 26 15:10:58.559846 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 568/1166] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:10:58 2021] GET /compute/v2.1/servers/fcd7d41b-b99b-4502-9ab8-7d51564e17a0 => generated 1265 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:10:59.576611 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-92cb4709-4b93-4a74-b158-f4a49b22c9ba tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:10:59.577170 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-92cb4709-4b93-4a74-b158-f4a49b22c9ba tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] [instance: fcd7d41b-b99b-4502-9ab8-7d51564e17a0] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:10:59.584453 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-92cb4709-4b93-4a74-b158-f4a49b22c9ba tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:10:59.584920 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-92cb4709-4b93-4a74-b158-f4a49b22c9ba tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:10:59.585730 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-92cb4709-4b93-4a74-b158-f4a49b22c9ba tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:10:59.586178 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-92cb4709-4b93-4a74-b158-f4a49b22c9ba tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:10:59.861210 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-92cb4709-4b93-4a74-b158-f4a49b22c9ba tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63852ad0e1224005bd20673b430b8a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511d07599f124852b029e4bc01cbdd7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:10:59.869314 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-92cb4709-4b93-4a74-b158-f4a49b22c9ba tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "GET /compute/v2.1/servers/fcd7d41b-b99b-4502-9ab8-7d51564e17a0" status: 200 len: 1265 microversion: 2.1 time: 0.296955 May 26 15:10:59.869916 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 599/1167] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:10:59 2021] GET /compute/v2.1/servers/fcd7d41b-b99b-4502-9ab8-7d51564e17a0 => generated 1265 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:11:00.885918 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-9802575d-fbe5-4b53-bfb9-348cf6851e8c tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:00.886656 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-9802575d-fbe5-4b53-bfb9-348cf6851e8c tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] [instance: fcd7d41b-b99b-4502-9ab8-7d51564e17a0] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:11:00.895759 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-9802575d-fbe5-4b53-bfb9-348cf6851e8c tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:11:00.896216 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-9802575d-fbe5-4b53-bfb9-348cf6851e8c tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:11:00.896997 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-9802575d-fbe5-4b53-bfb9-348cf6851e8c tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:11:00.897440 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-9802575d-fbe5-4b53-bfb9-348cf6851e8c tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:11:01.094329 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-9802575d-fbe5-4b53-bfb9-348cf6851e8c tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63852ad0e1224005bd20673b430b8a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511d07599f124852b029e4bc01cbdd7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:01.102630 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-9802575d-fbe5-4b53-bfb9-348cf6851e8c tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "GET /compute/v2.1/servers/fcd7d41b-b99b-4502-9ab8-7d51564e17a0" status: 200 len: 1265 microversion: 2.1 time: 0.220400 May 26 15:11:01.103192 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 569/1168] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:11:00 2021] GET /compute/v2.1/servers/fcd7d41b-b99b-4502-9ab8-7d51564e17a0 => generated 1265 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:11:02.119039 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-72b1ec77-9247-440d-afaa-1b8aec409a82 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:02.119649 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-72b1ec77-9247-440d-afaa-1b8aec409a82 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] [instance: fcd7d41b-b99b-4502-9ab8-7d51564e17a0] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:11:02.126948 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-72b1ec77-9247-440d-afaa-1b8aec409a82 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:11:02.127400 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-72b1ec77-9247-440d-afaa-1b8aec409a82 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:11:02.128165 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-72b1ec77-9247-440d-afaa-1b8aec409a82 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:11:02.128605 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-72b1ec77-9247-440d-afaa-1b8aec409a82 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:11:02.320537 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-72b1ec77-9247-440d-afaa-1b8aec409a82 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63852ad0e1224005bd20673b430b8a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511d07599f124852b029e4bc01cbdd7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:02.328702 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-72b1ec77-9247-440d-afaa-1b8aec409a82 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "GET /compute/v2.1/servers/fcd7d41b-b99b-4502-9ab8-7d51564e17a0" status: 200 len: 1265 microversion: 2.1 time: 0.213305 May 26 15:11:02.329266 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 600/1169] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:11:02 2021] GET /compute/v2.1/servers/fcd7d41b-b99b-4502-9ab8-7d51564e17a0 => generated 1265 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:11:03.345412 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-77740c9c-8d82-45ac-8e90-2e658a64990e tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:03.346093 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-77740c9c-8d82-45ac-8e90-2e658a64990e tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] [instance: fcd7d41b-b99b-4502-9ab8-7d51564e17a0] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:11:03.353445 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-77740c9c-8d82-45ac-8e90-2e658a64990e tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:11:03.353950 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-77740c9c-8d82-45ac-8e90-2e658a64990e tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:11:03.354731 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-77740c9c-8d82-45ac-8e90-2e658a64990e tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:11:03.355203 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-77740c9c-8d82-45ac-8e90-2e658a64990e tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:11:03.554556 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-77740c9c-8d82-45ac-8e90-2e658a64990e tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63852ad0e1224005bd20673b430b8a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511d07599f124852b029e4bc01cbdd7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:03.563729 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-77740c9c-8d82-45ac-8e90-2e658a64990e tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "GET /compute/v2.1/servers/fcd7d41b-b99b-4502-9ab8-7d51564e17a0" status: 200 len: 1265 microversion: 2.1 time: 0.222175 May 26 15:11:03.564229 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 570/1170] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:11:03 2021] GET /compute/v2.1/servers/fcd7d41b-b99b-4502-9ab8-7d51564e17a0 => generated 1265 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:11:04.580871 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-ae94e2a5-5ce6-4736-99c2-45c6d50c95e3 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:04.581482 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-ae94e2a5-5ce6-4736-99c2-45c6d50c95e3 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] [instance: fcd7d41b-b99b-4502-9ab8-7d51564e17a0] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:11:04.589447 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-ae94e2a5-5ce6-4736-99c2-45c6d50c95e3 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:11:04.589938 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-ae94e2a5-5ce6-4736-99c2-45c6d50c95e3 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:11:04.590733 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-ae94e2a5-5ce6-4736-99c2-45c6d50c95e3 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:11:04.591358 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-ae94e2a5-5ce6-4736-99c2-45c6d50c95e3 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:11:04.788258 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-ae94e2a5-5ce6-4736-99c2-45c6d50c95e3 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63852ad0e1224005bd20673b430b8a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511d07599f124852b029e4bc01cbdd7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:04.796906 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-ae94e2a5-5ce6-4736-99c2-45c6d50c95e3 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "GET /compute/v2.1/servers/fcd7d41b-b99b-4502-9ab8-7d51564e17a0" status: 200 len: 1265 microversion: 2.1 time: 0.220438 May 26 15:11:04.797439 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 601/1171] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:11:04 2021] GET /compute/v2.1/servers/fcd7d41b-b99b-4502-9ab8-7d51564e17a0 => generated 1265 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:11:05.813738 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-4522e070-358d-4be2-8d7e-328d4c9355d0 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:05.814390 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-4522e070-358d-4be2-8d7e-328d4c9355d0 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] [instance: fcd7d41b-b99b-4502-9ab8-7d51564e17a0] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:11:05.821637 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-4522e070-358d-4be2-8d7e-328d4c9355d0 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:11:05.822098 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-4522e070-358d-4be2-8d7e-328d4c9355d0 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:11:05.822896 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-4522e070-358d-4be2-8d7e-328d4c9355d0 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:11:05.823342 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-4522e070-358d-4be2-8d7e-328d4c9355d0 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:11:06.025652 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-4522e070-358d-4be2-8d7e-328d4c9355d0 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63852ad0e1224005bd20673b430b8a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511d07599f124852b029e4bc01cbdd7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:06.034842 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-4522e070-358d-4be2-8d7e-328d4c9355d0 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "GET /compute/v2.1/servers/fcd7d41b-b99b-4502-9ab8-7d51564e17a0" status: 200 len: 1265 microversion: 2.1 time: 0.225497 May 26 15:11:06.035438 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 571/1172] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:11:05 2021] GET /compute/v2.1/servers/fcd7d41b-b99b-4502-9ab8-7d51564e17a0 => generated 1265 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:11:07.051681 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-6bbc0bfd-cad4-446c-91d3-54eb2d6bc48b tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:07.052306 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-6bbc0bfd-cad4-446c-91d3-54eb2d6bc48b tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] [instance: fcd7d41b-b99b-4502-9ab8-7d51564e17a0] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:11:07.059801 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-6bbc0bfd-cad4-446c-91d3-54eb2d6bc48b tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:11:07.060265 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-6bbc0bfd-cad4-446c-91d3-54eb2d6bc48b tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:11:07.061050 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-6bbc0bfd-cad4-446c-91d3-54eb2d6bc48b tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:11:07.061562 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-6bbc0bfd-cad4-446c-91d3-54eb2d6bc48b tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:11:07.251568 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-6bbc0bfd-cad4-446c-91d3-54eb2d6bc48b tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63852ad0e1224005bd20673b430b8a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511d07599f124852b029e4bc01cbdd7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:07.259906 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-6bbc0bfd-cad4-446c-91d3-54eb2d6bc48b tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "GET /compute/v2.1/servers/fcd7d41b-b99b-4502-9ab8-7d51564e17a0" status: 200 len: 1265 microversion: 2.1 time: 0.211980 May 26 15:11:07.260490 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 602/1173] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:11:07 2021] GET /compute/v2.1/servers/fcd7d41b-b99b-4502-9ab8-7d51564e17a0 => generated 1265 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:11:07.977679 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [req-02ee2766-bffb-4c1e-8cd1-363c27431954 req-b7009143-5aef-4ced-820e-cc4bdb1200b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fcd7d41b-b99b-4502-9ab8-7d51564e17a0", "name": "network-vif-plugged", "status": "completed", "tag": "e19df163-9d36-4b27-a614-a95afeeb27c6"}]} {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:11:07.984453 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 15:11:07.984453 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: warnings.warn(msg) May 26 15:11:07.987533 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [req-02ee2766-bffb-4c1e-8cd1-363c27431954 req-b7009143-5aef-4ced-820e-cc4bdb1200b7 service nova] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:11:07.987984 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [req-02ee2766-bffb-4c1e-8cd1-363c27431954 req-b7009143-5aef-4ced-820e-cc4bdb1200b7 service nova] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:11:08.004455 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.compute.server_external_events [req-02ee2766-bffb-4c1e-8cd1-363c27431954 req-b7009143-5aef-4ced-820e-cc4bdb1200b7 service nova] Creating event network-vif-plugged:e19df163-9d36-4b27-a614-a95afeeb27c6 for instance fcd7d41b-b99b-4502-9ab8-7d51564e17a0 on hv-cinder-78414 May 26 15:11:08.009445 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [req-02ee2766-bffb-4c1e-8cd1-363c27431954 req-b7009143-5aef-4ced-820e-cc4bdb1200b7 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035616 May 26 15:11:08.013076 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 572/1174] 10.222.0.81 () {64 vars in 1318 bytes} [Wed May 26 15:11:07 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:11:08.232348 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 15:11:08.232904 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: Wed May 26 15:11:08 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 15:11:08.275873 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-984731db-776c-4721-ab26-f509f349e05c tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:08.276514 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-984731db-776c-4721-ab26-f509f349e05c tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] [instance: fcd7d41b-b99b-4502-9ab8-7d51564e17a0] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:11:08.284248 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-984731db-776c-4721-ab26-f509f349e05c tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:11:08.284706 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-984731db-776c-4721-ab26-f509f349e05c tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:11:08.285481 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-984731db-776c-4721-ab26-f509f349e05c tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:11:08.285948 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-984731db-776c-4721-ab26-f509f349e05c tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:11:08.487252 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-984731db-776c-4721-ab26-f509f349e05c tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63852ad0e1224005bd20673b430b8a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511d07599f124852b029e4bc01cbdd7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:08.495428 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-984731db-776c-4721-ab26-f509f349e05c tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "GET /compute/v2.1/servers/fcd7d41b-b99b-4502-9ab8-7d51564e17a0" status: 200 len: 1265 microversion: 2.1 time: 0.223109 May 26 15:11:08.495993 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 603/1175] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:11:08 2021] GET /compute/v2.1/servers/fcd7d41b-b99b-4502-9ab8-7d51564e17a0 => generated 1265 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:11:09.513424 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-9464df09-baa4-42d5-b94e-65861bad992f tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:09.514298 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-9464df09-baa4-42d5-b94e-65861bad992f tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] [instance: fcd7d41b-b99b-4502-9ab8-7d51564e17a0] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:11:09.522610 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-9464df09-baa4-42d5-b94e-65861bad992f tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:11:09.523085 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-9464df09-baa4-42d5-b94e-65861bad992f tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:11:09.523844 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-9464df09-baa4-42d5-b94e-65861bad992f tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:11:09.524278 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-9464df09-baa4-42d5-b94e-65861bad992f tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:11:09.726276 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-9464df09-baa4-42d5-b94e-65861bad992f tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63852ad0e1224005bd20673b430b8a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511d07599f124852b029e4bc01cbdd7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:09.734674 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-9464df09-baa4-42d5-b94e-65861bad992f tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "GET /compute/v2.1/servers/fcd7d41b-b99b-4502-9ab8-7d51564e17a0" status: 200 len: 1451 microversion: 2.1 time: 0.225393 May 26 15:11:09.742761 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 573/1176] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:11:09 2021] GET /compute/v2.1/servers/fcd7d41b-b99b-4502-9ab8-7d51564e17a0 => generated 1451 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:11:09.751586 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-bc1fdb5f-00c1-4106-8f2b-53b203fd84b6 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:11:09.752198 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-bc1fdb5f-00c1-4106-8f2b-53b203fd84b6 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] [instance: fcd7d41b-b99b-4502-9ab8-7d51564e17a0] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:11:09.759391 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-bc1fdb5f-00c1-4106-8f2b-53b203fd84b6 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:11:09.759851 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-bc1fdb5f-00c1-4106-8f2b-53b203fd84b6 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:11:09.760622 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-bc1fdb5f-00c1-4106-8f2b-53b203fd84b6 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:11:09.761064 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-bc1fdb5f-00c1-4106-8f2b-53b203fd84b6 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:11:09.959333 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-bc1fdb5f-00c1-4106-8f2b-53b203fd84b6 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63852ad0e1224005bd20673b430b8a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511d07599f124852b029e4bc01cbdd7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:11:09.967495 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-bc1fdb5f-00c1-4106-8f2b-53b203fd84b6 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "GET /compute/v2.1/servers/fcd7d41b-b99b-4502-9ab8-7d51564e17a0" status: 200 len: 1451 microversion: 2.1 time: 0.220276 May 26 15:11:09.968067 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 604/1177] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:11:09 2021] GET /compute/v2.1/servers/fcd7d41b-b99b-4502-9ab8-7d51564e17a0 => generated 1451 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:11:11.533404 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 15:11:11.534051 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: Wed May 26 15:11:11 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 15:11:12.750206 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [req-58ca04a0-25b0-4227-b4c2-6162445f7b86 req-09240f20-0e23-436e-a0fa-ad65b78b6910 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fcd7d41b-b99b-4502-9ab8-7d51564e17a0", "tag": "e19df163-9d36-4b27-a614-a95afeeb27c6"}]} {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:11:12.752038 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 15:11:12.752038 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: warnings.warn(msg) May 26 15:11:12.760675 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [req-58ca04a0-25b0-4227-b4c2-6162445f7b86 req-09240f20-0e23-436e-a0fa-ad65b78b6910 service nova] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:11:12.761213 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [req-58ca04a0-25b0-4227-b4c2-6162445f7b86 req-09240f20-0e23-436e-a0fa-ad65b78b6910 service nova] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:11:12.777970 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.compute.server_external_events [req-58ca04a0-25b0-4227-b4c2-6162445f7b86 req-09240f20-0e23-436e-a0fa-ad65b78b6910 service nova] Creating event network-changed:e19df163-9d36-4b27-a614-a95afeeb27c6 for instance fcd7d41b-b99b-4502-9ab8-7d51564e17a0 on hv-cinder-78414 May 26 15:11:12.783487 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [req-58ca04a0-25b0-4227-b4c2-6162445f7b86 req-09240f20-0e23-436e-a0fa-ad65b78b6910 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090001 May 26 15:11:12.784085 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 574/1178] 10.222.0.81 () {64 vars in 1318 bytes} [Wed May 26 15:11:12 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:12:59.843373 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 15:12:59.844046 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: Wed May 26 15:12:59 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 15:13:00.717605 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-826100f2-ff3a-4bd3-bccc-b4564c3bea81 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1159598016", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-143429190", "security_groups": [{"name": "tempest-secgroup-smoke-675203712"}], "block_device_mapping_v2": [{"uuid": "4603f91b-2e11-4d89-ba58-3ec68698a90b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "8cb13f82-5501-498d-8d6a-19501eaaa488"}]}} {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:13:00.874040 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.network.neutron [None req-826100f2-ff3a-4bd3-bccc-b4564c3bea81 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] validate_networks() for [('8cb13f82-5501-498d-8d6a-19501eaaa488', None, None, None)] {{(pid=118513) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} May 26 15:13:01.492654 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.virt.hardware [None req-826100f2-ff3a-4bd3-bccc-b4564c3bea81 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Flavor limits 0:0:0 {{(pid=118513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} May 26 15:13:01.493118 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.virt.hardware [None req-826100f2-ff3a-4bd3-bccc-b4564c3bea81 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Image limits 0:0:0 {{(pid=118513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} May 26 15:13:01.493661 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.virt.hardware [None req-826100f2-ff3a-4bd3-bccc-b4564c3bea81 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Flavor pref 0:0:0 {{(pid=118513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} May 26 15:13:01.494085 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.virt.hardware [None req-826100f2-ff3a-4bd3-bccc-b4564c3bea81 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Image pref 0:0:0 {{(pid=118513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} May 26 15:13:01.494505 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.virt.hardware [None req-826100f2-ff3a-4bd3-bccc-b4564c3bea81 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} May 26 15:13:01.502765 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-826100f2-ff3a-4bd3-bccc-b4564c3bea81 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:13:01.503224 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-826100f2-ff3a-4bd3-bccc-b4564c3bea81 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:13:01.504036 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-826100f2-ff3a-4bd3-bccc-b4564c3bea81 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:13:01.504482 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-826100f2-ff3a-4bd3-bccc-b4564c3bea81 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:13:01.521800 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.quota [None req-826100f2-ff3a-4bd3-bccc-b4564c3bea81 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Getting quotas for project 511d07599f124852b029e4bc01cbdd7f. Resources: {'instances', 'ram', 'cores'} {{(pid=118513) _get_quotas /opt/stack/nova/nova/quota.py:387}} May 26 15:13:01.525571 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.quota [None req-826100f2-ff3a-4bd3-bccc-b4564c3bea81 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Getting quotas for user 63852ad0e1224005bd20673b430b8a3d and project 511d07599f124852b029e4bc01cbdd7f. Resources: {'instances', 'ram', 'cores'} {{(pid=118513) _get_quotas /opt/stack/nova/nova/quota.py:377}} May 26 15:13:01.624305 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-826100f2-ff3a-4bd3-bccc-b4564c3bea81 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Going to run 1 instances... {{(pid=118513) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} May 26 15:13:01.626448 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-826100f2-ff3a-4bd3-bccc-b4564c3bea81 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] [instance: dfa8229d-e902-4b9b-a5ab-dd5fbd83964b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4603f91b-2e11-4d89-ba58-3ec68698a90b',volume_size=None,volume_type=None)] {{(pid=118513) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} May 26 15:13:02.103829 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-826100f2-ff3a-4bd3-bccc-b4564c3bea81 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.389847 May 26 15:13:02.104798 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 605/1179] 10.222.0.81 () {60 vars in 1147 bytes} [Wed May 26 15:13:00 2021] POST /compute/v2.1/servers => generated 405 bytes in 1391 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 26 15:13:02.112543 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: ERROR oslo.messaging._drivers.impl_rabbit [-] [dded7dfb-48a0-42b4-8c92-27c260f94da4] AMQP server on 10.222.0.81:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 26 15:13:02.116880 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-c07c9967-19df-4fd4-adae-4074d3ce0db0 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:02.117686 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-c07c9967-19df-4fd4-adae-4074d3ce0db0 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] [instance: dfa8229d-e902-4b9b-a5ab-dd5fbd83964b] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:13:02.193597 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-c07c9967-19df-4fd4-adae-4074d3ce0db0 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63852ad0e1224005bd20673b430b8a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511d07599f124852b029e4bc01cbdd7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:02.201589 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-c07c9967-19df-4fd4-adae-4074d3ce0db0 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "GET /compute/v2.1/servers/dfa8229d-e902-4b9b-a5ab-dd5fbd83964b" status: 200 len: 1094 microversion: 2.1 time: 0.090786 May 26 15:13:02.202360 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 575/1180] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:13:02 2021] GET /compute/v2.1/servers/dfa8229d-e902-4b9b-a5ab-dd5fbd83964b => generated 1094 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:13:03.219144 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-43e2c625-c47c-43da-9ecd-1b1a97fada54 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:03.219767 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-43e2c625-c47c-43da-9ecd-1b1a97fada54 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] [instance: dfa8229d-e902-4b9b-a5ab-dd5fbd83964b] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:13:03.228311 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-43e2c625-c47c-43da-9ecd-1b1a97fada54 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:13:03.228804 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-43e2c625-c47c-43da-9ecd-1b1a97fada54 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:13:03.229577 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-43e2c625-c47c-43da-9ecd-1b1a97fada54 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:13:03.230030 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-43e2c625-c47c-43da-9ecd-1b1a97fada54 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:13:03.346207 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-43e2c625-c47c-43da-9ecd-1b1a97fada54 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63852ad0e1224005bd20673b430b8a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511d07599f124852b029e4bc01cbdd7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:03.355390 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-43e2c625-c47c-43da-9ecd-1b1a97fada54 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "GET /compute/v2.1/servers/dfa8229d-e902-4b9b-a5ab-dd5fbd83964b" status: 200 len: 1144 microversion: 2.1 time: 0.139976 May 26 15:13:03.355975 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 606/1181] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:13:03 2021] GET /compute/v2.1/servers/dfa8229d-e902-4b9b-a5ab-dd5fbd83964b => generated 1144 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:13:04.372086 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-8aecee57-ea2b-4e30-bece-add68439c619 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:04.373733 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-8aecee57-ea2b-4e30-bece-add68439c619 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] [instance: dfa8229d-e902-4b9b-a5ab-dd5fbd83964b] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:13:04.396516 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO oslo.messaging._drivers.impl_rabbit [-] [dded7dfb-48a0-42b4-8c92-27c260f94da4] Reconnected to AMQP server on 10.222.0.81:5672 via [amqp] client with port 38562. May 26 15:13:04.400831 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-8aecee57-ea2b-4e30-bece-add68439c619 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:13:04.401296 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-8aecee57-ea2b-4e30-bece-add68439c619 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:13:04.402229 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-8aecee57-ea2b-4e30-bece-add68439c619 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:13:04.402564 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-8aecee57-ea2b-4e30-bece-add68439c619 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:13:04.531162 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-8aecee57-ea2b-4e30-bece-add68439c619 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63852ad0e1224005bd20673b430b8a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511d07599f124852b029e4bc01cbdd7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:04.540385 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-8aecee57-ea2b-4e30-bece-add68439c619 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "GET /compute/v2.1/servers/dfa8229d-e902-4b9b-a5ab-dd5fbd83964b" status: 200 len: 1210 microversion: 2.1 time: 0.171928 May 26 15:13:04.540987 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 576/1182] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:13:04 2021] GET /compute/v2.1/servers/dfa8229d-e902-4b9b-a5ab-dd5fbd83964b => generated 1210 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:13:05.557730 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-369d5413-af6e-4fa6-a81b-f63de183eb5c tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:05.558355 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-369d5413-af6e-4fa6-a81b-f63de183eb5c tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] [instance: dfa8229d-e902-4b9b-a5ab-dd5fbd83964b] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:13:05.566708 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-369d5413-af6e-4fa6-a81b-f63de183eb5c tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:13:05.567169 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-369d5413-af6e-4fa6-a81b-f63de183eb5c tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:13:05.567953 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-369d5413-af6e-4fa6-a81b-f63de183eb5c tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:13:05.568397 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-369d5413-af6e-4fa6-a81b-f63de183eb5c tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:13:05.782777 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-369d5413-af6e-4fa6-a81b-f63de183eb5c tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63852ad0e1224005bd20673b430b8a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511d07599f124852b029e4bc01cbdd7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:05.791806 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-369d5413-af6e-4fa6-a81b-f63de183eb5c tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "GET /compute/v2.1/servers/dfa8229d-e902-4b9b-a5ab-dd5fbd83964b" status: 200 len: 1277 microversion: 2.1 time: 0.237890 May 26 15:13:05.792377 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 607/1183] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:13:05 2021] GET /compute/v2.1/servers/dfa8229d-e902-4b9b-a5ab-dd5fbd83964b => generated 1277 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:13:06.586963 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [req-f7e1bc2e-a385-49d3-b6f1-a1128680377a req-00136362-704b-48e4-87fa-880198c7ea13 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dfa8229d-e902-4b9b-a5ab-dd5fbd83964b", "tag": "04f2a710-48f9-40d2-ad4b-9b24b6e85755"}]} {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:13:06.589101 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 15:13:06.589101 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: warnings.warn(msg) May 26 15:13:06.604317 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [req-f7e1bc2e-a385-49d3-b6f1-a1128680377a req-00136362-704b-48e4-87fa-880198c7ea13 service nova] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:13:06.605046 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [req-f7e1bc2e-a385-49d3-b6f1-a1128680377a req-00136362-704b-48e4-87fa-880198c7ea13 service nova] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:13:06.624964 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.compute.server_external_events [req-f7e1bc2e-a385-49d3-b6f1-a1128680377a req-00136362-704b-48e4-87fa-880198c7ea13 service nova] Creating event network-changed:04f2a710-48f9-40d2-ad4b-9b24b6e85755 for instance dfa8229d-e902-4b9b-a5ab-dd5fbd83964b on hv-cinder-78414 May 26 15:13:06.630812 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [req-f7e1bc2e-a385-49d3-b6f1-a1128680377a req-00136362-704b-48e4-87fa-880198c7ea13 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047501 May 26 15:13:06.631439 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 577/1184] 10.222.0.81 () {64 vars in 1318 bytes} [Wed May 26 15:13:06 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:13:06.808266 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-7b7a20ff-851d-452d-99df-8f42558c0507 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:06.808887 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-7b7a20ff-851d-452d-99df-8f42558c0507 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] [instance: dfa8229d-e902-4b9b-a5ab-dd5fbd83964b] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:13:06.816537 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-7b7a20ff-851d-452d-99df-8f42558c0507 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:13:06.817001 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-7b7a20ff-851d-452d-99df-8f42558c0507 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:13:06.817878 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-7b7a20ff-851d-452d-99df-8f42558c0507 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:13:06.818278 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-7b7a20ff-851d-452d-99df-8f42558c0507 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:13:07.022110 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-7b7a20ff-851d-452d-99df-8f42558c0507 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63852ad0e1224005bd20673b430b8a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511d07599f124852b029e4bc01cbdd7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:07.030360 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-7b7a20ff-851d-452d-99df-8f42558c0507 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "GET /compute/v2.1/servers/dfa8229d-e902-4b9b-a5ab-dd5fbd83964b" status: 200 len: 1265 microversion: 2.1 time: 0.225874 May 26 15:13:07.030928 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 608/1185] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:13:06 2021] GET /compute/v2.1/servers/dfa8229d-e902-4b9b-a5ab-dd5fbd83964b => generated 1265 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:13:08.047747 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-13c2a751-5aca-4578-9644-0c3020f75192 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:08.048429 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-13c2a751-5aca-4578-9644-0c3020f75192 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] [instance: dfa8229d-e902-4b9b-a5ab-dd5fbd83964b] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:13:08.056181 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-13c2a751-5aca-4578-9644-0c3020f75192 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:13:08.056631 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-13c2a751-5aca-4578-9644-0c3020f75192 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:13:08.057402 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-13c2a751-5aca-4578-9644-0c3020f75192 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:13:08.057853 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-13c2a751-5aca-4578-9644-0c3020f75192 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:13:08.348428 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-13c2a751-5aca-4578-9644-0c3020f75192 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63852ad0e1224005bd20673b430b8a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511d07599f124852b029e4bc01cbdd7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:08.356618 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-13c2a751-5aca-4578-9644-0c3020f75192 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "GET /compute/v2.1/servers/dfa8229d-e902-4b9b-a5ab-dd5fbd83964b" status: 200 len: 1265 microversion: 2.1 time: 0.313014 May 26 15:13:08.359939 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 578/1186] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:13:08 2021] GET /compute/v2.1/servers/dfa8229d-e902-4b9b-a5ab-dd5fbd83964b => generated 1265 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:13:09.373419 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-ace0b00d-a32f-42f0-b1b7-366ca4a4c396 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:09.374063 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-ace0b00d-a32f-42f0-b1b7-366ca4a4c396 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] [instance: dfa8229d-e902-4b9b-a5ab-dd5fbd83964b] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:13:09.382325 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-ace0b00d-a32f-42f0-b1b7-366ca4a4c396 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:13:09.382792 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-ace0b00d-a32f-42f0-b1b7-366ca4a4c396 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:13:09.383580 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-ace0b00d-a32f-42f0-b1b7-366ca4a4c396 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:13:09.384032 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-ace0b00d-a32f-42f0-b1b7-366ca4a4c396 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:13:09.576942 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-ace0b00d-a32f-42f0-b1b7-366ca4a4c396 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63852ad0e1224005bd20673b430b8a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511d07599f124852b029e4bc01cbdd7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:09.585208 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-ace0b00d-a32f-42f0-b1b7-366ca4a4c396 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "GET /compute/v2.1/servers/dfa8229d-e902-4b9b-a5ab-dd5fbd83964b" status: 200 len: 1265 microversion: 2.1 time: 0.215579 May 26 15:13:09.585799 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 609/1187] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:13:09 2021] GET /compute/v2.1/servers/dfa8229d-e902-4b9b-a5ab-dd5fbd83964b => generated 1265 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:13:10.602340 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-ca82cddb-937f-4749-a703-fd425ba526f1 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:10.602952 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-ca82cddb-937f-4749-a703-fd425ba526f1 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] [instance: dfa8229d-e902-4b9b-a5ab-dd5fbd83964b] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:13:10.610306 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-ca82cddb-937f-4749-a703-fd425ba526f1 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:13:10.610758 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-ca82cddb-937f-4749-a703-fd425ba526f1 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:13:10.612166 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-ca82cddb-937f-4749-a703-fd425ba526f1 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:13:10.612644 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-ca82cddb-937f-4749-a703-fd425ba526f1 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:13:10.808531 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-ca82cddb-937f-4749-a703-fd425ba526f1 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63852ad0e1224005bd20673b430b8a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511d07599f124852b029e4bc01cbdd7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:10.816733 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-ca82cddb-937f-4749-a703-fd425ba526f1 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "GET /compute/v2.1/servers/dfa8229d-e902-4b9b-a5ab-dd5fbd83964b" status: 200 len: 1265 microversion: 2.1 time: 0.218034 May 26 15:13:10.817304 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 579/1188] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:13:10 2021] GET /compute/v2.1/servers/dfa8229d-e902-4b9b-a5ab-dd5fbd83964b => generated 1265 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:13:11.833885 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-8c7e5528-d594-441f-8ae6-f0c7306582f5 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:11.834510 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-8c7e5528-d594-441f-8ae6-f0c7306582f5 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] [instance: dfa8229d-e902-4b9b-a5ab-dd5fbd83964b] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:13:11.841830 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-8c7e5528-d594-441f-8ae6-f0c7306582f5 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:13:11.842300 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-8c7e5528-d594-441f-8ae6-f0c7306582f5 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:13:11.843098 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-8c7e5528-d594-441f-8ae6-f0c7306582f5 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:13:11.843546 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-8c7e5528-d594-441f-8ae6-f0c7306582f5 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:13:12.043438 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-8c7e5528-d594-441f-8ae6-f0c7306582f5 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63852ad0e1224005bd20673b430b8a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511d07599f124852b029e4bc01cbdd7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:12.051711 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-8c7e5528-d594-441f-8ae6-f0c7306582f5 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "GET /compute/v2.1/servers/dfa8229d-e902-4b9b-a5ab-dd5fbd83964b" status: 200 len: 1265 microversion: 2.1 time: 0.222208 May 26 15:13:12.052351 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 610/1189] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:13:11 2021] GET /compute/v2.1/servers/dfa8229d-e902-4b9b-a5ab-dd5fbd83964b => generated 1265 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:13:13.067761 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-e3a837d3-7511-4ec3-a0a1-0d2e35bcf188 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:13.068378 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-e3a837d3-7511-4ec3-a0a1-0d2e35bcf188 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] [instance: dfa8229d-e902-4b9b-a5ab-dd5fbd83964b] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:13:13.075672 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-e3a837d3-7511-4ec3-a0a1-0d2e35bcf188 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:13:13.076140 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-e3a837d3-7511-4ec3-a0a1-0d2e35bcf188 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:13:13.076950 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-e3a837d3-7511-4ec3-a0a1-0d2e35bcf188 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:13:13.077391 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-e3a837d3-7511-4ec3-a0a1-0d2e35bcf188 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:13:13.273551 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-e3a837d3-7511-4ec3-a0a1-0d2e35bcf188 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63852ad0e1224005bd20673b430b8a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511d07599f124852b029e4bc01cbdd7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:13.281940 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-e3a837d3-7511-4ec3-a0a1-0d2e35bcf188 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "GET /compute/v2.1/servers/dfa8229d-e902-4b9b-a5ab-dd5fbd83964b" status: 200 len: 1265 microversion: 2.1 time: 0.217861 May 26 15:13:13.282503 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 580/1190] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:13:13 2021] GET /compute/v2.1/servers/dfa8229d-e902-4b9b-a5ab-dd5fbd83964b => generated 1265 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:13:14.298552 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-ca575c11-2746-43cc-ae48-bff99d32ccec tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:14.299994 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-ca575c11-2746-43cc-ae48-bff99d32ccec tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] [instance: dfa8229d-e902-4b9b-a5ab-dd5fbd83964b] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:13:14.307426 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-ca575c11-2746-43cc-ae48-bff99d32ccec tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:13:14.307887 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-ca575c11-2746-43cc-ae48-bff99d32ccec tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:13:14.308669 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-ca575c11-2746-43cc-ae48-bff99d32ccec tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:13:14.309111 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-ca575c11-2746-43cc-ae48-bff99d32ccec tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:13:14.510137 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-ca575c11-2746-43cc-ae48-bff99d32ccec tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63852ad0e1224005bd20673b430b8a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511d07599f124852b029e4bc01cbdd7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:14.518690 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-ca575c11-2746-43cc-ae48-bff99d32ccec tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "GET /compute/v2.1/servers/dfa8229d-e902-4b9b-a5ab-dd5fbd83964b" status: 200 len: 1265 microversion: 2.1 time: 0.223819 May 26 15:13:14.519196 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 611/1191] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:13:14 2021] GET /compute/v2.1/servers/dfa8229d-e902-4b9b-a5ab-dd5fbd83964b => generated 1265 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:13:15.535148 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-b3f7c476-93ba-413a-aadc-94f710db6665 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:15.535779 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-b3f7c476-93ba-413a-aadc-94f710db6665 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] [instance: dfa8229d-e902-4b9b-a5ab-dd5fbd83964b] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:13:15.543075 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-b3f7c476-93ba-413a-aadc-94f710db6665 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:13:15.543532 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-b3f7c476-93ba-413a-aadc-94f710db6665 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:13:15.544304 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-b3f7c476-93ba-413a-aadc-94f710db6665 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:13:15.544740 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-b3f7c476-93ba-413a-aadc-94f710db6665 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:13:15.746159 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-b3f7c476-93ba-413a-aadc-94f710db6665 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63852ad0e1224005bd20673b430b8a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511d07599f124852b029e4bc01cbdd7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:15.754951 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-b3f7c476-93ba-413a-aadc-94f710db6665 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "GET /compute/v2.1/servers/dfa8229d-e902-4b9b-a5ab-dd5fbd83964b" status: 200 len: 1265 microversion: 2.1 time: 0.223540 May 26 15:13:15.755529 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 581/1192] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:13:15 2021] GET /compute/v2.1/servers/dfa8229d-e902-4b9b-a5ab-dd5fbd83964b => generated 1265 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:13:16.703239 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [req-e2e48afa-d15b-469b-9d57-976504998f64 req-3a8e4b33-4a45-4baf-8208-f7f4642fa4f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfa8229d-e902-4b9b-a5ab-dd5fbd83964b", "name": "network-vif-plugged", "status": "completed", "tag": "04f2a710-48f9-40d2-ad4b-9b24b6e85755"}]} {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:13:16.707354 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 15:13:16.707354 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: warnings.warn(msg) May 26 15:13:16.713039 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [req-e2e48afa-d15b-469b-9d57-976504998f64 req-3a8e4b33-4a45-4baf-8208-f7f4642fa4f2 service nova] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:13:16.713483 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [req-e2e48afa-d15b-469b-9d57-976504998f64 req-3a8e4b33-4a45-4baf-8208-f7f4642fa4f2 service nova] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:13:16.729415 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.compute.server_external_events [req-e2e48afa-d15b-469b-9d57-976504998f64 req-3a8e4b33-4a45-4baf-8208-f7f4642fa4f2 service nova] Creating event network-vif-plugged:04f2a710-48f9-40d2-ad4b-9b24b6e85755 for instance dfa8229d-e902-4b9b-a5ab-dd5fbd83964b on hv-cinder-78414 May 26 15:13:16.735701 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [req-e2e48afa-d15b-469b-9d57-976504998f64 req-3a8e4b33-4a45-4baf-8208-f7f4642fa4f2 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035558 May 26 15:13:16.735701 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 612/1193] 10.222.0.81 () {64 vars in 1318 bytes} [Wed May 26 15:13:16 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 15:13:16.772195 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-489bead2-bca8-427e-acb9-0ec8da13dab9 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:16.772819 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-489bead2-bca8-427e-acb9-0ec8da13dab9 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] [instance: dfa8229d-e902-4b9b-a5ab-dd5fbd83964b] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:13:16.780080 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-489bead2-bca8-427e-acb9-0ec8da13dab9 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:13:16.781706 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-489bead2-bca8-427e-acb9-0ec8da13dab9 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:13:16.781706 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-489bead2-bca8-427e-acb9-0ec8da13dab9 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:13:16.781922 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-489bead2-bca8-427e-acb9-0ec8da13dab9 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:13:16.978904 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-489bead2-bca8-427e-acb9-0ec8da13dab9 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63852ad0e1224005bd20673b430b8a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511d07599f124852b029e4bc01cbdd7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:16.987450 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-489bead2-bca8-427e-acb9-0ec8da13dab9 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "GET /compute/v2.1/servers/dfa8229d-e902-4b9b-a5ab-dd5fbd83964b" status: 200 len: 1265 microversion: 2.1 time: 0.219188 May 26 15:13:16.988084 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 582/1194] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:13:16 2021] GET /compute/v2.1/servers/dfa8229d-e902-4b9b-a5ab-dd5fbd83964b => generated 1265 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:13:18.004767 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-ecf954c4-4c8b-41d3-8cee-260f8a7cea25 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:18.005471 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-ecf954c4-4c8b-41d3-8cee-260f8a7cea25 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] [instance: dfa8229d-e902-4b9b-a5ab-dd5fbd83964b] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:13:18.013169 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-ecf954c4-4c8b-41d3-8cee-260f8a7cea25 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:13:18.013647 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-ecf954c4-4c8b-41d3-8cee-260f8a7cea25 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:13:18.014469 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-ecf954c4-4c8b-41d3-8cee-260f8a7cea25 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:13:18.014920 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-ecf954c4-4c8b-41d3-8cee-260f8a7cea25 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:13:18.211607 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-ecf954c4-4c8b-41d3-8cee-260f8a7cea25 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63852ad0e1224005bd20673b430b8a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511d07599f124852b029e4bc01cbdd7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:18.219979 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-ecf954c4-4c8b-41d3-8cee-260f8a7cea25 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "GET /compute/v2.1/servers/dfa8229d-e902-4b9b-a5ab-dd5fbd83964b" status: 200 len: 1452 microversion: 2.1 time: 0.219491 May 26 15:13:18.221044 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 613/1195] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:13:17 2021] GET /compute/v2.1/servers/dfa8229d-e902-4b9b-a5ab-dd5fbd83964b => generated 1452 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:13:18.236034 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-f17dd9c2-1cc6-4bf7-ae01-2c82cd81a05c tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:13:18.237342 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-f17dd9c2-1cc6-4bf7-ae01-2c82cd81a05c tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] [instance: dfa8229d-e902-4b9b-a5ab-dd5fbd83964b] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:13:18.244457 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-f17dd9c2-1cc6-4bf7-ae01-2c82cd81a05c tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:13:18.244905 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-f17dd9c2-1cc6-4bf7-ae01-2c82cd81a05c tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:13:18.245702 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-f17dd9c2-1cc6-4bf7-ae01-2c82cd81a05c tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:13:18.246134 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-f17dd9c2-1cc6-4bf7-ae01-2c82cd81a05c tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:13:18.443510 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-f17dd9c2-1cc6-4bf7-ae01-2c82cd81a05c tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63852ad0e1224005bd20673b430b8a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511d07599f124852b029e4bc01cbdd7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:13:18.451621 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-f17dd9c2-1cc6-4bf7-ae01-2c82cd81a05c tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "GET /compute/v2.1/servers/dfa8229d-e902-4b9b-a5ab-dd5fbd83964b" status: 200 len: 1452 microversion: 2.1 time: 0.219191 May 26 15:13:18.452189 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 583/1196] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:13:18 2021] GET /compute/v2.1/servers/dfa8229d-e902-4b9b-a5ab-dd5fbd83964b => generated 1452 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:13:21.313634 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [req-b64c589f-ea78-43ec-8cfa-b8905bba2aeb req-3b58eeed-b392-4502-9383-ffd4839bc550 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dfa8229d-e902-4b9b-a5ab-dd5fbd83964b", "tag": "04f2a710-48f9-40d2-ad4b-9b24b6e85755"}]} {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:13:21.313634 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 15:13:21.313634 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: warnings.warn(msg) May 26 15:13:21.320023 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [req-b64c589f-ea78-43ec-8cfa-b8905bba2aeb req-3b58eeed-b392-4502-9383-ffd4839bc550 service nova] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:13:21.320559 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [req-b64c589f-ea78-43ec-8cfa-b8905bba2aeb req-3b58eeed-b392-4502-9383-ffd4839bc550 service nova] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:13:21.336822 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.compute.server_external_events [req-b64c589f-ea78-43ec-8cfa-b8905bba2aeb req-3b58eeed-b392-4502-9383-ffd4839bc550 service nova] Creating event network-changed:04f2a710-48f9-40d2-ad4b-9b24b6e85755 for instance dfa8229d-e902-4b9b-a5ab-dd5fbd83964b on hv-cinder-78414 May 26 15:13:21.341761 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [req-b64c589f-ea78-43ec-8cfa-b8905bba2aeb req-3b58eeed-b392-4502-9383-ffd4839bc550 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036340 May 26 15:13:21.342381 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 614/1197] 10.222.0.81 () {64 vars in 1318 bytes} [Wed May 26 15:13:21 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:13:38.494407 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 15:13:38.494984 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: Wed May 26 15:13:38 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 15:14:28.250974 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 15:14:28.251586 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: Wed May 26 15:14:28 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 15:14:54.173108 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-a5062f1d-ae83-4264-bdd9-a44fe716f44d tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:14:54.173802 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-a5062f1d-ae83-4264-bdd9-a44fe716f44d tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] [instance: dfa8229d-e902-4b9b-a5ab-dd5fbd83964b] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:14:54.183922 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ff6f2ecd-1b47-49c8-9039-c025e0c4e3e6] AMQP server on 10.222.0.81:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 26 15:14:54.189414 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-a5062f1d-ae83-4264-bdd9-a44fe716f44d tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:14:54.189906 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-a5062f1d-ae83-4264-bdd9-a44fe716f44d tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:14:54.190698 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-a5062f1d-ae83-4264-bdd9-a44fe716f44d tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:14:54.191141 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-a5062f1d-ae83-4264-bdd9-a44fe716f44d tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:14:54.252898 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-a5062f1d-ae83-4264-bdd9-a44fe716f44d tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] [instance: dfa8229d-e902-4b9b-a5ab-dd5fbd83964b] Going to try to terminate instance {{(pid=118514) delete /opt/stack/nova/nova/compute/api.py:2539}} May 26 15:14:54.257579 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [req-69f91e86-8e87-4c65-8b89-4e3b1206e0d3 req-a1adb010-f45e-4438-9941-0525ee78586a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dfa8229d-e902-4b9b-a5ab-dd5fbd83964b", "tag": "04f2a710-48f9-40d2-ad4b-9b24b6e85755"}]} {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:14:54.259048 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 15:14:54.259048 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: warnings.warn(msg) May 26 15:14:54.269103 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [req-69f91e86-8e87-4c65-8b89-4e3b1206e0d3 req-a1adb010-f45e-4438-9941-0525ee78586a service nova] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:14:54.271034 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [req-69f91e86-8e87-4c65-8b89-4e3b1206e0d3 req-a1adb010-f45e-4438-9941-0525ee78586a service nova] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:14:54.285102 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.compute.server_external_events [req-69f91e86-8e87-4c65-8b89-4e3b1206e0d3 req-a1adb010-f45e-4438-9941-0525ee78586a service nova] Creating event network-changed:04f2a710-48f9-40d2-ad4b-9b24b6e85755 for instance dfa8229d-e902-4b9b-a5ab-dd5fbd83964b on hv-cinder-78414 May 26 15:14:54.290290 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [req-69f91e86-8e87-4c65-8b89-4e3b1206e0d3 req-a1adb010-f45e-4438-9941-0525ee78586a service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111130 May 26 15:14:54.291207 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 615/1198] 10.222.0.81 () {64 vars in 1318 bytes} [Wed May 26 15:14:54 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:14:54.628586 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-a5062f1d-ae83-4264-bdd9-a44fe716f44d tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "DELETE /compute/v2.1/servers/dfa8229d-e902-4b9b-a5ab-dd5fbd83964b" status: 204 len: 0 microversion: 2.1 time: 0.458875 May 26 15:14:54.632421 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 584/1199] 10.222.0.81 () {58 vars in 1239 bytes} [Wed May 26 15:14:54 2021] DELETE /compute/v2.1/servers/dfa8229d-e902-4b9b-a5ab-dd5fbd83964b => generated 0 bytes in 460 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 15:14:54.638605 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-a3a31c71-e0d6-4b3d-a55a-490502c3f601 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:14:54.639428 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-a3a31c71-e0d6-4b3d-a55a-490502c3f601 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] [instance: dfa8229d-e902-4b9b-a5ab-dd5fbd83964b] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:14:54.647222 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-a3a31c71-e0d6-4b3d-a55a-490502c3f601 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:14:54.647703 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-a3a31c71-e0d6-4b3d-a55a-490502c3f601 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:14:54.648576 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-a3a31c71-e0d6-4b3d-a55a-490502c3f601 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:14:54.649097 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-a3a31c71-e0d6-4b3d-a55a-490502c3f601 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:14:54.900750 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-a3a31c71-e0d6-4b3d-a55a-490502c3f601 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63852ad0e1224005bd20673b430b8a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511d07599f124852b029e4bc01cbdd7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:54.911347 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-a3a31c71-e0d6-4b3d-a55a-490502c3f601 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "GET /compute/v2.1/servers/dfa8229d-e902-4b9b-a5ab-dd5fbd83964b" status: 200 len: 1577 microversion: 2.1 time: 0.277177 May 26 15:14:54.912250 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 616/1200] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:14:54 2021] GET /compute/v2.1/servers/dfa8229d-e902-4b9b-a5ab-dd5fbd83964b => generated 1577 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 15:14:55.930952 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-236cef94-c436-4f67-9264-d409f150e359 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:14:55.931846 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-236cef94-c436-4f67-9264-d409f150e359 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] [instance: dfa8229d-e902-4b9b-a5ab-dd5fbd83964b] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:14:55.939722 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-236cef94-c436-4f67-9264-d409f150e359 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:14:55.940201 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-236cef94-c436-4f67-9264-d409f150e359 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:14:55.940973 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-236cef94-c436-4f67-9264-d409f150e359 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:14:55.941402 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-236cef94-c436-4f67-9264-d409f150e359 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:14:56.484162 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-236cef94-c436-4f67-9264-d409f150e359 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63852ad0e1224005bd20673b430b8a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511d07599f124852b029e4bc01cbdd7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:56.493494 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-236cef94-c436-4f67-9264-d409f150e359 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "GET /compute/v2.1/servers/dfa8229d-e902-4b9b-a5ab-dd5fbd83964b" status: 200 len: 1458 microversion: 2.1 time: 0.566742 May 26 15:14:56.494111 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 585/1201] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:14:55 2021] GET /compute/v2.1/servers/dfa8229d-e902-4b9b-a5ab-dd5fbd83964b => generated 1458 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:14:57.141854 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [req-7b27e611-01c8-4281-b4b9-f8d0c5456944 req-c01df2d6-19f7-441d-940e-ac9b99914737 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfa8229d-e902-4b9b-a5ab-dd5fbd83964b", "name": "network-vif-deleted", "tag": "04f2a710-48f9-40d2-ad4b-9b24b6e85755"}]} {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:14:57.143365 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 15:14:57.143365 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: warnings.warn(msg) May 26 15:14:57.163363 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [req-7b27e611-01c8-4281-b4b9-f8d0c5456944 req-c01df2d6-19f7-441d-940e-ac9b99914737 service nova] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:14:57.163813 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [req-7b27e611-01c8-4281-b4b9-f8d0c5456944 req-c01df2d6-19f7-441d-940e-ac9b99914737 service nova] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:14:57.182539 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.compute.server_external_events [req-7b27e611-01c8-4281-b4b9-f8d0c5456944 req-c01df2d6-19f7-441d-940e-ac9b99914737 service nova] Creating event network-vif-deleted:04f2a710-48f9-40d2-ad4b-9b24b6e85755 for instance dfa8229d-e902-4b9b-a5ab-dd5fbd83964b on hv-cinder-78414 May 26 15:14:57.185925 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO oslo.messaging._drivers.impl_rabbit [-] [ff6f2ecd-1b47-49c8-9039-c025e0c4e3e6] Reconnected to AMQP server on 10.222.0.81:5672 via [amqp] client with port 38642. May 26 15:14:57.187540 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [req-7b27e611-01c8-4281-b4b9-f8d0c5456944 req-c01df2d6-19f7-441d-940e-ac9b99914737 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050122 May 26 15:14:57.188662 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 617/1202] 10.222.0.81 () {64 vars in 1318 bytes} [Wed May 26 15:14:57 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:14:57.510869 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-0ce1c522-01bf-42f5-aa1c-66baba2535dd tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:14:57.511485 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-0ce1c522-01bf-42f5-aa1c-66baba2535dd tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] [instance: dfa8229d-e902-4b9b-a5ab-dd5fbd83964b] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:14:57.520348 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-0ce1c522-01bf-42f5-aa1c-66baba2535dd tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:14:57.520812 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-0ce1c522-01bf-42f5-aa1c-66baba2535dd tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:14:57.521627 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-0ce1c522-01bf-42f5-aa1c-66baba2535dd tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:14:57.522077 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-0ce1c522-01bf-42f5-aa1c-66baba2535dd tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:14:57.740948 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-0ce1c522-01bf-42f5-aa1c-66baba2535dd tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63852ad0e1224005bd20673b430b8a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511d07599f124852b029e4bc01cbdd7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:14:57.749501 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-0ce1c522-01bf-42f5-aa1c-66baba2535dd tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "GET /compute/v2.1/servers/dfa8229d-e902-4b9b-a5ab-dd5fbd83964b" status: 200 len: 1225 microversion: 2.1 time: 0.242492 May 26 15:14:57.750074 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 586/1203] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:14:57 2021] GET /compute/v2.1/servers/dfa8229d-e902-4b9b-a5ab-dd5fbd83964b => generated 1225 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:14:58.768798 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-ce9b9a6c-e8eb-49d2-b03a-fdf4aad4450e tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:14:58.769533 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-ce9b9a6c-e8eb-49d2-b03a-fdf4aad4450e tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] [instance: dfa8229d-e902-4b9b-a5ab-dd5fbd83964b] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:14:58.777065 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-ce9b9a6c-e8eb-49d2-b03a-fdf4aad4450e tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:14:58.781982 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-ce9b9a6c-e8eb-49d2-b03a-fdf4aad4450e tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:14:58.781982 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-ce9b9a6c-e8eb-49d2-b03a-fdf4aad4450e tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:14:58.781982 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-ce9b9a6c-e8eb-49d2-b03a-fdf4aad4450e tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:14:58.827209 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.wsgi [None req-ce9b9a6c-e8eb-49d2-b03a-fdf4aad4450e tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] HTTP exception thrown: Instance dfa8229d-e902-4b9b-a5ab-dd5fbd83964b could not be found. May 26 15:14:58.827749 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-ce9b9a6c-e8eb-49d2-b03a-fdf4aad4450e tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Returning 404 to user: Instance dfa8229d-e902-4b9b-a5ab-dd5fbd83964b could not be found. {{(pid=118513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 26 15:14:58.828656 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-ce9b9a6c-e8eb-49d2-b03a-fdf4aad4450e tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "GET /compute/v2.1/servers/dfa8229d-e902-4b9b-a5ab-dd5fbd83964b" status: 404 len: 111 microversion: 2.1 time: 0.064896 May 26 15:14:58.829792 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 618/1204] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:14:58 2021] GET /compute/v2.1/servers/dfa8229d-e902-4b9b-a5ab-dd5fbd83964b => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 15:15:03.112619 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-859099ee-5199-4d20-a9c5-05d650aad642 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:03.113411 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-859099ee-5199-4d20-a9c5-05d650aad642 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] [instance: fcd7d41b-b99b-4502-9ab8-7d51564e17a0] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:15:03.115827 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [req-2feb31ac-bd25-4bab-adba-c8163406cbb8 req-b3bceb06-b1a2-4868-9688-f9dd5533eb7d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fcd7d41b-b99b-4502-9ab8-7d51564e17a0", "tag": "e19df163-9d36-4b27-a614-a95afeeb27c6"}]} {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:15:03.117510 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 15:15:03.117510 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: warnings.warn(msg) May 26 15:15:03.121006 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-859099ee-5199-4d20-a9c5-05d650aad642 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:15:03.121558 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-859099ee-5199-4d20-a9c5-05d650aad642 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:15:03.122433 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-859099ee-5199-4d20-a9c5-05d650aad642 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:15:03.123127 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-859099ee-5199-4d20-a9c5-05d650aad642 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:15:03.126661 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [req-2feb31ac-bd25-4bab-adba-c8163406cbb8 req-b3bceb06-b1a2-4868-9688-f9dd5533eb7d service nova] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:15:03.127415 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [req-2feb31ac-bd25-4bab-adba-c8163406cbb8 req-b3bceb06-b1a2-4868-9688-f9dd5533eb7d service nova] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:15:03.143899 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.compute.server_external_events [req-2feb31ac-bd25-4bab-adba-c8163406cbb8 req-b3bceb06-b1a2-4868-9688-f9dd5533eb7d service nova] Creating event network-changed:e19df163-9d36-4b27-a614-a95afeeb27c6 for instance fcd7d41b-b99b-4502-9ab8-7d51564e17a0 on hv-cinder-78414 May 26 15:15:03.149065 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [req-2feb31ac-bd25-4bab-adba-c8163406cbb8 req-b3bceb06-b1a2-4868-9688-f9dd5533eb7d service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036777 May 26 15:15:03.149872 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 619/1205] 10.222.0.81 () {64 vars in 1318 bytes} [Wed May 26 15:15:03 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:15:03.189370 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-859099ee-5199-4d20-a9c5-05d650aad642 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] [instance: fcd7d41b-b99b-4502-9ab8-7d51564e17a0] Going to try to terminate instance {{(pid=118514) delete /opt/stack/nova/nova/compute/api.py:2539}} May 26 15:15:03.559386 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-859099ee-5199-4d20-a9c5-05d650aad642 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "DELETE /compute/v2.1/servers/fcd7d41b-b99b-4502-9ab8-7d51564e17a0" status: 204 len: 0 microversion: 2.1 time: 0.450999 May 26 15:15:03.565189 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 587/1206] 10.222.0.81 () {58 vars in 1239 bytes} [Wed May 26 15:15:03 2021] DELETE /compute/v2.1/servers/fcd7d41b-b99b-4502-9ab8-7d51564e17a0 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 15:15:03.568876 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-9ed0a7e5-4f2e-4010-80c6-eb198ac5f077 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:03.569613 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-9ed0a7e5-4f2e-4010-80c6-eb198ac5f077 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] [instance: fcd7d41b-b99b-4502-9ab8-7d51564e17a0] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:15:03.577602 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-9ed0a7e5-4f2e-4010-80c6-eb198ac5f077 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:15:03.578070 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-9ed0a7e5-4f2e-4010-80c6-eb198ac5f077 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:15:03.579382 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-9ed0a7e5-4f2e-4010-80c6-eb198ac5f077 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:15:03.580040 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-9ed0a7e5-4f2e-4010-80c6-eb198ac5f077 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:15:03.788056 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.policy [None req-9ed0a7e5-4f2e-4010-80c6-eb198ac5f077 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63852ad0e1224005bd20673b430b8a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511d07599f124852b029e4bc01cbdd7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118513) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:03.796791 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-9ed0a7e5-4f2e-4010-80c6-eb198ac5f077 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "GET /compute/v2.1/servers/fcd7d41b-b99b-4502-9ab8-7d51564e17a0" status: 200 len: 1576 microversion: 2.1 time: 0.231924 May 26 15:15:03.797565 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 620/1207] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:15:03 2021] GET /compute/v2.1/servers/fcd7d41b-b99b-4502-9ab8-7d51564e17a0 => generated 1576 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:15:04.814888 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-b164e4da-9d57-423e-a491-be96f89c3dc5 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:04.815593 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-b164e4da-9d57-423e-a491-be96f89c3dc5 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] [instance: fcd7d41b-b99b-4502-9ab8-7d51564e17a0] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:15:04.822783 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-b164e4da-9d57-423e-a491-be96f89c3dc5 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:15:04.823234 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-b164e4da-9d57-423e-a491-be96f89c3dc5 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:15:04.824006 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-b164e4da-9d57-423e-a491-be96f89c3dc5 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:15:04.824443 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-b164e4da-9d57-423e-a491-be96f89c3dc5 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:15:05.134849 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-b164e4da-9d57-423e-a491-be96f89c3dc5 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63852ad0e1224005bd20673b430b8a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511d07599f124852b029e4bc01cbdd7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:05.144315 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-b164e4da-9d57-423e-a491-be96f89c3dc5 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "GET /compute/v2.1/servers/fcd7d41b-b99b-4502-9ab8-7d51564e17a0" status: 200 len: 1457 microversion: 2.1 time: 0.333785 May 26 15:15:05.144902 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 588/1208] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:15:04 2021] GET /compute/v2.1/servers/fcd7d41b-b99b-4502-9ab8-7d51564e17a0 => generated 1457 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:15:05.965372 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [req-0015c052-5b4b-4863-8d1a-a680e417e4e9 req-ddb29808-6478-4310-a39b-4be0b83399c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fcd7d41b-b99b-4502-9ab8-7d51564e17a0", "name": "network-vif-deleted", "tag": "e19df163-9d36-4b27-a614-a95afeeb27c6"}]} {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 15:15:05.966982 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 15:15:05.966982 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: warnings.warn(msg) May 26 15:15:05.975306 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [req-0015c052-5b4b-4863-8d1a-a680e417e4e9 req-ddb29808-6478-4310-a39b-4be0b83399c4 service nova] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:15:05.975971 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [req-0015c052-5b4b-4863-8d1a-a680e417e4e9 req-ddb29808-6478-4310-a39b-4be0b83399c4 service nova] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:15:05.991975 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.compute.server_external_events [req-0015c052-5b4b-4863-8d1a-a680e417e4e9 req-ddb29808-6478-4310-a39b-4be0b83399c4 service nova] Creating event network-vif-deleted:e19df163-9d36-4b27-a614-a95afeeb27c6 for instance fcd7d41b-b99b-4502-9ab8-7d51564e17a0 on hv-cinder-78414 May 26 15:15:05.996906 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [req-0015c052-5b4b-4863-8d1a-a680e417e4e9 req-ddb29808-6478-4310-a39b-4be0b83399c4 service nova] 10.222.0.81 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035117 May 26 15:15:05.997615 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 621/1209] 10.222.0.81 () {64 vars in 1318 bytes} [Wed May 26 15:15:05 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 15:15:06.160265 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-667e91c9-eb44-47c4-a668-d9dba9d3fc76 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:06.161431 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-667e91c9-eb44-47c4-a668-d9dba9d3fc76 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] [instance: fcd7d41b-b99b-4502-9ab8-7d51564e17a0] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:15:06.168939 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-667e91c9-eb44-47c4-a668-d9dba9d3fc76 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:15:06.169399 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-667e91c9-eb44-47c4-a668-d9dba9d3fc76 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:15:06.170221 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-667e91c9-eb44-47c4-a668-d9dba9d3fc76 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:15:06.170789 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-667e91c9-eb44-47c4-a668-d9dba9d3fc76 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:15:06.357338 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.policy [None req-667e91c9-eb44-47c4-a668-d9dba9d3fc76 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63852ad0e1224005bd20673b430b8a3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511d07599f124852b029e4bc01cbdd7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118514) authorize /opt/stack/nova/nova/policy.py:199}} May 26 15:15:06.366445 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-667e91c9-eb44-47c4-a668-d9dba9d3fc76 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "GET /compute/v2.1/servers/fcd7d41b-b99b-4502-9ab8-7d51564e17a0" status: 200 len: 1225 microversion: 2.1 time: 0.210061 May 26 15:15:06.368123 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 589/1210] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:15:06 2021] GET /compute/v2.1/servers/fcd7d41b-b99b-4502-9ab8-7d51564e17a0 => generated 1225 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 15:15:07.383732 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-6bf7940f-f300-4157-88f9-17efe77eda06 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:07.390251 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-6bf7940f-f300-4157-88f9-17efe77eda06 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] [instance: fcd7d41b-b99b-4502-9ab8-7d51564e17a0] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:15:07.392919 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-6bf7940f-f300-4157-88f9-17efe77eda06 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:15:07.393371 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-6bf7940f-f300-4157-88f9-17efe77eda06 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:15:07.394184 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-6bf7940f-f300-4157-88f9-17efe77eda06 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:15:07.394632 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-6bf7940f-f300-4157-88f9-17efe77eda06 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:15:07.446883 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.wsgi [None req-6bf7940f-f300-4157-88f9-17efe77eda06 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] HTTP exception thrown: Instance fcd7d41b-b99b-4502-9ab8-7d51564e17a0 could not be found. May 26 15:15:07.447498 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-6bf7940f-f300-4157-88f9-17efe77eda06 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Returning 404 to user: Instance fcd7d41b-b99b-4502-9ab8-7d51564e17a0 could not be found. {{(pid=118513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 26 15:15:07.448336 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-6bf7940f-f300-4157-88f9-17efe77eda06 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "GET /compute/v2.1/servers/fcd7d41b-b99b-4502-9ab8-7d51564e17a0" status: 404 len: 111 microversion: 2.1 time: 0.068792 May 26 15:15:07.448885 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 622/1211] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:15:07 2021] GET /compute/v2.1/servers/fcd7d41b-b99b-4502-9ab8-7d51564e17a0 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 15:15:08.314947 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-3bf56468-3215-4644-9de6-b025390e97ad tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Calling method '>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:08.315455 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.compute.api [None req-3bf56468-3215-4644-9de6-b025390e97ad tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] [instance: 7dcf546b-91d5-4718-b3f0-dee33dda4ce7] Fetching instance by UUID {{(pid=118514) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:15:08.322694 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-3bf56468-3215-4644-9de6-b025390e97ad tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:15:08.323155 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-3bf56468-3215-4644-9de6-b025390e97ad tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:15:08.323936 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-3bf56468-3215-4644-9de6-b025390e97ad tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:15:08.324380 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG oslo_concurrency.lockutils [None req-3bf56468-3215-4644-9de6-b025390e97ad tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118514) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:15:08.372848 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.wsgi [None req-3bf56468-3215-4644-9de6-b025390e97ad tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] HTTP exception thrown: Instance 7dcf546b-91d5-4718-b3f0-dee33dda4ce7 could not be found. May 26 15:15:08.373380 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-3bf56468-3215-4644-9de6-b025390e97ad tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Returning 404 to user: Instance 7dcf546b-91d5-4718-b3f0-dee33dda4ce7 could not be found. {{(pid=118514) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 26 15:15:08.374236 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-3bf56468-3215-4644-9de6-b025390e97ad tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "DELETE /compute/v2.1/servers/7dcf546b-91d5-4718-b3f0-dee33dda4ce7" status: 404 len: 111 microversion: 2.1 time: 0.063343 May 26 15:15:08.374784 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 590/1212] 10.222.0.81 () {58 vars in 1239 bytes} [Wed May 26 15:15:08 2021] DELETE /compute/v2.1/servers/7dcf546b-91d5-4718-b3f0-dee33dda4ce7 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 15:15:08.382823 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-6e92e7ab-7a53-46d6-a9f5-ca0233ac791a tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Calling method '>' {{(pid=118513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:08.383467 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.compute.api [None req-6e92e7ab-7a53-46d6-a9f5-ca0233ac791a tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] [instance: 7dcf546b-91d5-4718-b3f0-dee33dda4ce7] Fetching instance by UUID {{(pid=118513) get /opt/stack/nova/nova/compute/api.py:2790}} May 26 15:15:08.391684 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-6e92e7ab-7a53-46d6-a9f5-ca0233ac791a tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:15:08.396087 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-6e92e7ab-7a53-46d6-a9f5-ca0233ac791a tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:15:08.396087 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-6e92e7ab-7a53-46d6-a9f5-ca0233ac791a tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} May 26 15:15:08.396087 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG oslo_concurrency.lockutils [None req-6e92e7ab-7a53-46d6-a9f5-ca0233ac791a tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Lock "1138cb42-e84c-4925-8485-16faa4f9e877" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} May 26 15:15:08.442091 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.wsgi [None req-6e92e7ab-7a53-46d6-a9f5-ca0233ac791a tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] HTTP exception thrown: Instance 7dcf546b-91d5-4718-b3f0-dee33dda4ce7 could not be found. May 26 15:15:08.442688 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: DEBUG nova.api.openstack.wsgi [None req-6e92e7ab-7a53-46d6-a9f5-ca0233ac791a tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Returning 404 to user: Instance 7dcf546b-91d5-4718-b3f0-dee33dda4ce7 could not be found. {{(pid=118513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} May 26 15:15:08.443505 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO nova.api.openstack.requestlog [None req-6e92e7ab-7a53-46d6-a9f5-ca0233ac791a tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "GET /compute/v2.1/servers/7dcf546b-91d5-4718-b3f0-dee33dda4ce7" status: 404 len: 111 microversion: 2.1 time: 0.064403 May 26 15:15:08.444039 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: [pid: 118513|app: 0|req: 623/1213] 10.222.0.81 () {58 vars in 1236 bytes} [Wed May 26 15:15:08 2021] GET /compute/v2.1/servers/7dcf546b-91d5-4718-b3f0-dee33dda4ce7 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 15:15:10.269457 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: DEBUG nova.api.openstack.wsgi [None req-111308f6-a6cf-4e72-898e-a960eae2f715 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] Calling method '.version_select at 0x7f441e3479d0>' {{(pid=118514) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 15:15:10.360897 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO nova.api.openstack.requestlog [None req-111308f6-a6cf-4e72-898e-a960eae2f715 tempest-TestVolumeBootPattern-834638603 tempest-TestVolumeBootPattern-834638603-project] 10.222.0.81 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-143429190" status: 202 len: 0 microversion: 2.1 time: 0.095721 May 26 15:15:10.361457 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: [pid: 118514|app: 0|req: 591/1214] 10.222.0.81 () {58 vars in 1260 bytes} [Wed May 26 15:15:10 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-143429190 => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 15:15:56.372026 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 15:15:56.372559 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: Wed May 26 15:15:56 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 15:16:19.862703 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 15:16:19.863249 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: Wed May 26 15:16:19 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 15:17:48.269246 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 15:17:48.269902 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: Wed May 26 15:17:48 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 15:17:51.555286 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 15:17:51.555791 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: Wed May 26 15:17:51 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 15:18:07.810550 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 15:18:07.811168 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: Wed May 26 15:18:07 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 15:19:16.390005 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 15:19:16.390632 dv-cinder-784140-4-iscsi devstack@n-api.service[118513]: Wed May 26 15:19:16 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 15:19:39.880997 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 15:19:39.881595 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: Wed May 26 15:19:39 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 15:20:18.517557 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 15:20:18.518266 dv-cinder-784140-4-iscsi devstack@n-api.service[118514]: Wed May 26 15:20:18 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!